Concepts
Core concepts for understanding how Convoy works.
Overview
Convoy is a batch processing system that:
- Collects individual requests via the API
- Batches them based on configurable thresholds
- Submits batches to AI providers
- Delivers results to your callback URLs
Key Components
- Convoy API — Service for request submission and tracking
- Convoy Worker — Background service for batch orchestration and delivery
- Database — Persistent storage for requests and results
Learn More
- Supported Models — Browse all supported models
- Authentication — Projects and API keys
- Callbacks — Result delivery mechanism
Last updated on