The fastest open-source AI gateway for LLMs, MCP and agents
One API for 72 leading AI models from 15 labs with unified billing and automatic failover
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
NZ
Pricing model
Freemium
Paid
Pricing
Bifrost OSS is free forever. Bifrost Enterprise has custom pricing; contact sales for a quote.
Prepaid USD balance with per-token pricing. Text models from $0.627 input / $1.881 output per 1M tokens. Image generation from $0.011 per image. Video generation from $0.043 per second. Card top-ups from $5 with 5.5% fee ($0.80 minimum). Trial credit: $1 for 7 days.
Key features
Drop-in replacement for any AI SDK with support for OpenAI, Anthropic, and LiteLLM
Model catalog providing access to 1000+ AI models from 8+ providers
Automatic provider failover for 99.99% uptime
Budget management and rate limiting across virtual keys and teams
Built-in OpenTelemetry observability
MCP gateway for centralized tool connections and governance
Real-time guardrails for blocking unsafe model outputs
Virtual key management with independent budgets and access control
Semantic caching to reduce costs and latency
Enterprise clustering with high availability and zero-downtime deployments
OpenAI and Anthropic API format compatibility
Automatic failover routing to backup routes
Bring your own keys (BYOK) with 1M free monthly requests
Unified USD billing with per-token pricing
Image and video generation support
Team and project-level access controls
Usage tracking with per-model details and exports
Support for streaming with standard server-sent events
Automatic route verification at least weekly
What makes it different
50x faster than LiteLLM with P99 latency of 20 microseconds at 5k requests per second
Zero-touch in-VPC deployments ensure no data leaves your infrastructure
Free and open source with Apache 2.0 license
Works seamlessly with all major LLM frameworks including OpenAI, Anthropic, LangChain, and LiteLLM
Enterprise-grade governance with SSO, RBAC, and audit logs included in Enterprise tier
All 72 models through one API with unified billing, no separate accounts needed
Leading models priced at or below official list prices
Automatic failover keeps requests on the same model even when a route fails
Free BYOK plan with 1M monthly requests using your own provider keys
Per-token billing with token counts and prices shown per request
Bifrost
BoostRail