The fastest open-source AI gateway for LLMs, MCP and agents
Intelligent model routing that cuts LLM token costs and latency
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Freemium
Paid
Pricing
Bifrost OSS is free forever. Bifrost Enterprise has custom pricing; contact sales for a quote.
Pay-as-you-go with 1% service fee. Cheap Tasks: $0.000043–$0.000194 per reference request. Standard Tasks: $0.000225–$0.000838 per reference request. Reasoning Tasks: $0.00066–$0.0023 per reference request. Frontier Tasks: $0.0023–$0.0354 per reference request. Agentic Tasks: $0.0071–$0.0354 per ref
Key features
Drop-in replacement for any AI SDK with support for OpenAI, Anthropic, and LiteLLM
Model catalog providing access to 1000+ AI models from 8+ providers
Automatic provider failover for 99.99% uptime
Budget management and rate limiting across virtual keys and teams
Built-in OpenTelemetry observability
MCP gateway for centralized tool connections and governance
Real-time guardrails for blocking unsafe model outputs
Virtual key management with independent budgets and access control
Semantic caching to reduce costs and latency
Enterprise clustering with high availability and zero-downtime deployments
Automatic task classification with Jev decision model
Multi-provider model access (OpenRouter, Kie.ai, Replicate, fal.ai)
Lowest-price eligible model selection
Support for text, image, video and audio modalities
Budget limits and provider filtering
Transparent billing and cost tracking
Three question types: Choice, Score and Noul
Pay-as-you-go pricing with no subscription
What makes it different
50x faster than LiteLLM with P99 latency of 20 microseconds at 5k requests per second
Zero-touch in-VPC deployments ensure no data leaves your infrastructure
Free and open source with Apache 2.0 license
Works seamlessly with all major LLM frameworks including OpenAI, Anthropic, LangChain, and LiteLLM
Enterprise-grade governance with SSO, RBAC, and audit logs included in Enterprise tier
Jev decision model automatically matches tasks to appropriate capability tiers instead of fixed frontier model routing
Reduces costs by up to 43.9% on illustrative workloads compared to fixed-model routing
Single API key for four different providers with unified billing
Works with multiple modalities and use cases like triage, classification and gating
Bifrost
Token Cut