Open-source engine for faster local language model inference with bit-for-bit identical output
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Not given
Open source
Pricing
Free: $0 with 60 requests/minute and 1,000 requests/day for first 7 days, then standard limits. Team: $70 per organization per month for up to 10 members with 600 requests/min. Enterprise: Custom annual pricing. Personal plan for IQ Code: $6 per month with 2,000 routing decisions.
Not given
Key features
Multi-provider support (OpenAI, Anthropic, Google, Mistral, xAI, DeepSeek)
Built-in model routing for cost optimization
Per-person usage tracking without prompt visibility
Zero Data Retention (ZDR) option
Speculative decoding for faster token generation
Prompt caching for context reuse
Real-time prompt processing while typing
Concurrent request batching
Bit-for-bit identical output verification
Multi-GPU and multi-backend support (CUDA, Vulkan)
Vision model support with image encoding
Mixture-of-experts model support
RAD-1 automatic draft token generation
Cross-platform support for Windows and Linux
What makes it different
Privacy-first monitoring: usage analytics without storing prompt or completion text by default
Support for any OpenAI- or Anthropic-shaped endpoint through single gateway URL
Exact deterministic inference: all default optimizations preserve bit-for-bit identical output compared to plain decoding
4.5× faster performance on editing tasks on small models compared to llama.cpp
Verifiable reproducibility through receipt system that records all request parameters
Nine optimization techniques enabled by default with ability to disable each individually
No dependency on draft models or external selections for speculative decoding