The fastest open-source AI gateway for LLMs, MCP and agents
Deploy GPU applications on supported community hardware and cloud capacity
Stage
Not given
Startup
Founded
Not given
2026
Based in
Not given
SA
Pricing model
Freemium
Paid
Pricing
Bifrost OSS is free forever. Bifrost Enterprise has custom pricing; contact sales for a quote.
One published price per GPU model in USD per GPU-hour. Hosts keep 90% of completed rental fees and Petabyte keeps 10%. A reservation holds funds, with final charges and returned balance following settlement after the run completes.
Key features
Drop-in replacement for any AI SDK with support for OpenAI, Anthropic, and LiteLLM
Model catalog providing access to 1000+ AI models from 8+ providers
Automatic provider failover for 99.99% uptime
Budget management and rate limiting across virtual keys and teams
Built-in OpenTelemetry observability
MCP gateway for centralized tool connections and governance
Real-time guardrails for blocking unsafe model outputs
Virtual key management with independent budgets and access control
Semantic caching to reduce costs and latency
Enterprise clustering with high availability and zero-downtime deployments
Choose from available GPU hardware with published hourly rates
Review cost estimates before deployment starts
Start from ready-made template applications
Monitor workload lifecycle states, logs and outputs
Connect your own GPU hardware as a host
Escrow-based payment system for secure transactions
Support for inference model requests
What makes it different
50x faster than LiteLLM with P99 latency of 20 microseconds at 5k requests per second
Zero-touch in-VPC deployments ensure no data leaves your infrastructure
Free and open source with Apache 2.0 license
Works seamlessly with all major LLM frameworks including OpenAI, Anthropic, LangChain, and LiteLLM
Enterprise-grade governance with SSO, RBAC, and audit logs included in Enterprise tier
Escrow payment ensures work is delivered before host is paid
Transparent pricing: all rates published upfront with no surprises
Minimal transaction fees: hosts keep 90% of rental earnings
Automatic refunds for failed rentals on platform side
Bifrost