Affordable AI API gateway for frontier models at up to 89% below official pricing
Open-source AI gateway you run yourself
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Paid
Open source
Pricing
Pay per million tokens in USD with no subscription or minimum spend. Prices vary by model and provider. Example flagship models: Claude (from $5.9/$29.5 input/output per million tokens), GPT-6-Astra (from $0.175/$0.875), Claude Opus (from $0.0125/$0.0625). Prompt caching at 10% of input rate where s
Not given
Key features
OpenAI-compatible endpoint
Access to 171 frontier models
Automatic failover across upstream providers
Per-token billing from upstream usage reports
Full SSE streaming passthrough
Per-key rate limits and model allowlists
Complete usage logs with cost breakdown
Anthropic Messages API support
Prompt caching at 10% of input rate
Health tracking per provider family
Single sign-on with OpenID Connect and two-factor authentication
Format translation through KPP canonical format, allowing any SDK to call any model
Spend and token budgets with hard limits that are never skipped
Complete request logging with status, tokens, cost, timing and content when permitted
Encrypted provider key storage with AES-256-GCM
Web console for managing organizations, projects, members, roles and request logs
Stateless Rust gateway for horizontal scaling
Support for 14 built-in AI providers
Docker Compose deployment with Caddy, PostgreSQL, Valkey and ClickHouse
Error reporting that names unsupported fields instead of silently dropping them
What makes it different
Single API key for 171 models across 19 families with no per-provider signups
Up to 89% savings below official pricing on frontier models
Automatic failover ensures requests route around capacity outages
Pay only for tokens consumed with no monthly subscription or minimum spend
Exact billing metered from upstream usage, never estimated from characters
OpenID Connect single sign-on and two-factor authentication included in the open-source code, not an enterprise edition
Hard budgets with worst-case reserves for every request to prevent burst overruns
Single MIT-licensed repository for gateway, console, KPP and UI library with no separate enterprise version
Rust gateway architecture with no interpreter on the hot path for performance
AtmoRouter
Kaeso