The fastest open-source AI gateway for LLMs, MCP and agents
Sovereign, carbon-aware AI routing
Stage
Not given
MVP
Founded
Not given
Not given
Based in
Not given
FR
Pricing model
Freemium
Paid
Pricing
Bifrost OSS is free forever. Bifrost Enterprise has custom pricing; contact sales for a quote.
Pay-as-you-go credits. Top-up fees: Business rate 5.5% + €0.30, Standard rate 6.5% + €0.30, International 8.5% + €0.30. Minimum top-up €5.00. Tokens billed at upstream provider's per-token price in EUR with no per-token markup.
Key features
Drop-in replacement for any AI SDK with support for OpenAI, Anthropic, and LiteLLM
Model catalog providing access to 1000+ AI models from 8+ providers
Automatic provider failover for 99.99% uptime
Budget management and rate limiting across virtual keys and teams
Built-in OpenTelemetry observability
MCP gateway for centralized tool connections and governance
Real-time guardrails for blocking unsafe model outputs
Virtual key management with independent budgets and access control
Semantic caching to reduce costs and latency
Enterprise clustering with high availability and zero-downtime deployments
OpenAI-compatible API, works with existing SDKs and tools without modification
Per-request carbon emissions tracking and grid carbon intensity reporting
Multi-provider routing with choice of provider, model, and region per request
Model aliases for repointing requests without code changes
Auto-routing to select lowest-carbon route based on policy
Jurisdiction filtering including EU-only provider option
Usage dashboard with per-model, per-provider, and per-key breakdown
CSV export for auditable per-request usage and carbon data
One invoice for all providers with automatic EUR conversion
No lock-in with base URL configuration allowing instant provider switching
What makes it different
50x faster than LiteLLM with P99 latency of 20 microseconds at 5k requests per second
Zero-touch in-VPC deployments ensure no data leaves your infrastructure
Free and open source with Apache 2.0 license
Works seamlessly with all major LLM frameworks including OpenAI, Anthropic, LangChain, and LiteLLM
Enterprise-grade governance with SSO, RBAC, and audit logs included in Enterprise tier
Sovereign EU hosting outside CLOUD Act reach with GDPR compliance and your choice of provider jurisdiction per request
No data training or retention; prompts forwarded unchanged to chosen provider only
Bifrost