Concepts
Core concepts for understanding how Convoy works.
Overview
Convoy is a batch processing system that:
- Collects individual requests via the API
- Batches them based on configurable thresholds
- Submits batches to AI providers (Bedrock, Anthropic)
- Delivers results to your callback URLs
Key Components
- Convoy API - FastAPI service for request submission and tracking
- Convoy Worker - Temporal worker for batch orchestration
- Temporal - Workflow engine for reliable execution
- PostgreSQL - Persistent storage for requests and results
Learn More
- Architecture - System design and data flow
- Cargo Lifecycle - Request status transitions
- Callbacks - Result delivery mechanism
Last updated on