The fastest open-source AI gateway for LLMs, MCP and agents
Compress prompts and reduce LLM API costs while preserving answers
Stage
Not given
Startup
Founded
Not given
2024
Based in
Not given
Not given
Pricing model
Freemium
Free
Pricing
Bifrost OSS is free forever. Bifrost Enterprise has custom pricing; contact sales for a quote.
Open beta: $0/month with unlimited API calls, all features, and no credit card required. After beta: a generous free tier and simple usage plans with early users keeping their perks.
Key features
Drop-in replacement for any AI SDK with support for OpenAI, Anthropic, and LiteLLM
Model catalog providing access to 1000+ AI models from 8+ providers
Automatic provider failover for 99.99% uptime
Budget management and rate limiting across virtual keys and teams
Built-in OpenTelemetry observability
MCP gateway for centralized tool connections and governance
Real-time guardrails for blocking unsafe model outputs
Virtual key management with independent budgets and access control
Semantic caching to reduce costs and latency
Enterprise clustering with high availability and zero-downtime deployments
Compress long prompts, logs and documents by removing filler while preserving code, numbers and facts
Convert web pages to clean Markdown instead of raw HTML
Shrink JSON responses into TOON format with headers and CSV-like rows
Available as MCP server for Claude, Cursor, Windsurf and VS Code
Gateway integration for OpenAI and Anthropic SDKs
REST API for direct integration
Self-hosted or hosted gateway options
Dashboard showing token and cost savings
Works with any chat model including local models
Output modes to control answer verbosity: lite, caveman and ultra
What makes it different
50x faster than LiteLLM with P99 latency of 20 microseconds at 5k requests per second
Zero-touch in-VPC deployments ensure no data leaves your infrastructure
Free and open source with Apache 2.0 license
Works seamlessly with all major LLM frameworks including OpenAI, Anthropic, LangChain, and LiteLLM
Enterprise-grade governance with SSO, RBAC, and audit logs included in Enterprise tier
Rule-based compression takes milliseconds without using another LLM
Your API key never leaves your infrastructure when using self-hosted gateway
Streaming, tool calling and function calling work unchanged
Real-world savings up to 42% on monthly LLM bills according to calculator
Bifrost
AgentReady