| Tier | Coverage | Cost / 1K req | Status |
|---|---|---|---|
LOCAL Ollama · llama.cpp · vLLM · R2 | $0 | PROVEN | |
FAST claude-haiku-4-5 · Groq · OpenAI mini | $0.001 | LIVE | |
CAPABLE claude-sonnet-4-6 · GPT-4o · Gemini | $0.005 | LIVE | |
MAX 20X Flat rate · Undifferentiated · April 2026 | $200/mo | DISPLACED |
# mc.yaml — migrate from flat-rate in 60 seconds providers: local: type: ollama model: llama3.2:3b # free, runs on your machine cost_per_1k: 0.0 fallback: type: anthropic api_key: ${ANTHROPIC_API_KEY} # your key, your billing model: claude-haiku-4-5-20251001 cost_per_1k: 0.001 routing: cost_ceiling: 0.01 cascade_on_failure: true calibration: preset_v1
# modelcascade.yaml providers: local: type: ollama model: llama3.2:3b cost_per_1k: 0.0 fast: type: anthropic api_key: ${ANTHROPIC_API_KEY} model: claude-haiku-4-5-20251001 cost_per_1k: 0.001 capable: type: anthropic api_key: ${ANTHROPIC_API_KEY} model: claude-sonnet-4-6 cost_per_1k: 0.005 routing: cost_ceiling: 0.01 # per request, hard stop cascade_on_failure: true calibration: preset_v1 # production-calibrated escalation: quality_or_timeout # Works with: LangChain · CrewAI · Claude Code · Custom
Nothing breaks. Your requests keep routing. We notify you at 80% and 100%. Overage is billed at the same per-request rate — no surprise multipliers. You can also set a hard cap: "never exceed $X/mo" and we stop routing to paid models when you hit it.
They get cheaper. Overnight routing shifts batch requests to the lowest-cost models — typically 95% local routing vs 74% during peak hours. Your morning report shows exactly what ran, which models were used, and what it cost. You review, not relay.
No. ModelCascade is open source (MIT). The routing engine runs in your environment. We never see your prompts and never proxy your API calls. Paid tiers add managed keys, analytics, and support — not routing capability. You can leave anytime and keep the same pip package running.
Probably not yet. Start with Pro. When you want a shared dashboard or need cost-per-project tags for your manager's quarterly review, upgrade. Scale exists for organizational accountability, not technical capability.