The fastest open-source AI gateway for LLMs, MCP and agents
Affordable AI API gateway for frontier models at up to 89% below official pricing
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Freemium
Paid
Pricing
Bifrost OSS is free forever. Bifrost Enterprise has custom pricing; contact sales for a quote.
Pay per million tokens in USD with no subscription or minimum spend. Prices vary by model and provider. Example flagship models: Claude (from $5.9/$29.5 input/output per million tokens), GPT-6-Astra (from $0.175/$0.875), Claude Opus (from $0.0125/$0.0625). Prompt caching at 10% of input rate where s
Key features
Drop-in replacement for any AI SDK with support for OpenAI, Anthropic, and LiteLLM
Model catalog providing access to 1000+ AI models from 8+ providers
Automatic provider failover for 99.99% uptime
Budget management and rate limiting across virtual keys and teams
Built-in OpenTelemetry observability
MCP gateway for centralized tool connections and governance
Real-time guardrails for blocking unsafe model outputs
Virtual key management with independent budgets and access control
Semantic caching to reduce costs and latency
Enterprise clustering with high availability and zero-downtime deployments
OpenAI-compatible endpoint
Access to 171 frontier models
Automatic failover across upstream providers
Per-token billing from upstream usage reports
Full SSE streaming passthrough
Per-key rate limits and model allowlists
Complete usage logs with cost breakdown
Anthropic Messages API support
Prompt caching at 10% of input rate
Health tracking per provider family
What makes it different
50x faster than LiteLLM with P99 latency of 20 microseconds at 5k requests per second
Zero-touch in-VPC deployments ensure no data leaves your infrastructure
Free and open source with Apache 2.0 license
Works seamlessly with all major LLM frameworks including OpenAI, Anthropic, LangChain, and LiteLLM
Enterprise-grade governance with SSO, RBAC, and audit logs included in Enterprise tier
Single API key for 171 models across 19 families with no per-provider signups
Up to 89% savings below official pricing on frontier models
Automatic failover ensures requests route around capacity outages
Pay only for tokens consumed with no monthly subscription or minimum spend
Exact billing metered from upstream usage, never estimated from characters
Bifrost
AtmoRouter