Compress prompts and reduce LLM API costs while preserving answers
Stage
Not given
Startup
Founded
Not given
2024
Based in
Not given
Not given
Pricing model
Open source
Free
Pricing
Not given
Open beta: $0/month with unlimited API calls, all features, and no credit card required. After beta: a generous free tier and simple usage plans with early users keeping their perks.
Key features
Single sign-on with OpenID Connect and two-factor authentication
Format translation through KPP canonical format, allowing any SDK to call any model
Spend and token budgets with hard limits that are never skipped
Complete request logging with status, tokens, cost, timing and content when permitted
Encrypted provider key storage with AES-256-GCM
Web console for managing organizations, projects, members, roles and request logs
Stateless Rust gateway for horizontal scaling
Support for 14 built-in AI providers
Docker Compose deployment with Caddy, PostgreSQL, Valkey and ClickHouse
Error reporting that names unsupported fields instead of silently dropping them
Compress long prompts, logs and documents by removing filler while preserving code, numbers and facts
Convert web pages to clean Markdown instead of raw HTML
Shrink JSON responses into TOON format with headers and CSV-like rows
Available as MCP server for Claude, Cursor, Windsurf and VS Code
Gateway integration for OpenAI and Anthropic SDKs
REST API for direct integration
Self-hosted or hosted gateway options
Dashboard showing token and cost savings
Works with any chat model including local models
Output modes to control answer verbosity: lite, caveman and ultra
What makes it different
OpenID Connect single sign-on and two-factor authentication included in the open-source code, not an enterprise edition
Hard budgets with worst-case reserves for every request to prevent burst overruns
Single MIT-licensed repository for gateway, console, KPP and UI library with no separate enterprise version
Rust gateway architecture with no interpreter on the hot path for performance
Rule-based compression takes milliseconds without using another LLM
Your API key never leaves your infrastructure when using self-hosted gateway
Streaming, tool calling and function calling work unchanged
Real-world savings up to 42% on monthly LLM bills according to calculator
Kaeso
AgentReady