Anthropic

Use Anthropic’s Message Batches API directly.

Prerequisites

• Anthropic API key

Configuration

# .env
ANTHROPIC_API_KEY=sk-ant-api03-...

Supported Models

Example Request

curl -X POST http://localhost:8000/cargo/load \
  -H "Content-Type: application/json" \
  -d '{
    "params": {
      "model": "claude-sonnet-4-5",
      "max_tokens": 100,
      "messages": [{"role": "user", "content": "Hello"}]
    },
    "callback_url": "https://example.com/callback"
  }'

How It Works

1. Convoy collects requests
2. Submits batch via Anthropic Message Batches API
3. Polls batch status until complete
4. Retrieves results from API
5. Delivers results via callbacks

API Limits

Anthropic batch API has these limits:

Convoy’s default batch size (100) is well within these limits.

Pricing

Batch API pricing is typically 50% cheaper than real-time API. Check Anthropic’s pricing page  for current rates.