Intelligent model routing that cuts LLM token costs and latency
Open-source AI gateway you run yourself
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Paid
Open source
Pricing
Pay-as-you-go with 1% service fee. Cheap Tasks: $0.000043–$0.000194 per reference request. Standard Tasks: $0.000225–$0.000838 per reference request. Reasoning Tasks: $0.00066–$0.0023 per reference request. Frontier Tasks: $0.0023–$0.0354 per reference request. Agentic Tasks: $0.0071–$0.0354 per ref
Not given
Key features
Automatic task classification with Jev decision model
Multi-provider model access (OpenRouter, Kie.ai, Replicate, fal.ai)
Lowest-price eligible model selection
Support for text, image, video and audio modalities
Budget limits and provider filtering
Transparent billing and cost tracking
Three question types: Choice, Score and Noul
Pay-as-you-go pricing with no subscription
Single sign-on with OpenID Connect and two-factor authentication
Format translation through KPP canonical format, allowing any SDK to call any model
Spend and token budgets with hard limits that are never skipped
Complete request logging with status, tokens, cost, timing and content when permitted
Encrypted provider key storage with AES-256-GCM
Web console for managing organizations, projects, members, roles and request logs
Stateless Rust gateway for horizontal scaling
Support for 14 built-in AI providers
Docker Compose deployment with Caddy, PostgreSQL, Valkey and ClickHouse
Error reporting that names unsupported fields instead of silently dropping them
What makes it different
Jev decision model automatically matches tasks to appropriate capability tiers instead of fixed frontier model routing
Reduces costs by up to 43.9% on illustrative workloads compared to fixed-model routing
Single API key for four different providers with unified billing
Works with multiple modalities and use cases like triage, classification and gating
OpenID Connect single sign-on and two-factor authentication included in the open-source code, not an enterprise edition
Hard budgets with worst-case reserves for every request to prevent burst overruns
Single MIT-licensed repository for gateway, console, KPP and UI library with no separate enterprise version
Rust gateway architecture with no interpreter on the hot path for performance
Token Cut
Kaeso