Open-source engine for faster local language model inference with bit-for-bit identical output
Linux sandboxes for Claude Code, Codex and Cursor over MCP protocol
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Open source
Paid
Pricing
Not given
Plans from $10 to $1,000 per month. Credit lands each month and boxes bill by the hour: Nano $10/month ($0.014/hour), Micro $25/month ($0.034/hour), Extra Small $50/month ($0.068/hour), Small $100/month ($0.137/hour), Medium $250/month ($0.342/hour), Large $500/month ($0.685/hour), Extra Large $1,00
Key features
Speculative decoding for faster token generation
Prompt caching for context reuse
Real-time prompt processing while typing
Concurrent request batching
Bit-for-bit identical output verification
Multi-GPU and multi-backend support (CUDA, Vulkan)
Vision model support with image encoding
Mixture-of-experts model support
RAD-1 automatic draft token generation
Cross-platform support for Windows and Linux
Sign up without API key or credit card
Fork running sandboxes to run work in parallel
Pause and resume sandboxes
Pre-configured images with Python, Node.js and git
Upload and download files between project and sandbox
Idle sandboxes auto-pause after 15 minutes
Paused sandboxes auto-delete after 7 days
What makes it different
Exact deterministic inference: all default optimizations preserve bit-for-bit identical output compared to plain decoding
4.5× faster performance on editing tasks on small models compared to llama.cpp
Verifiable reproducibility through receipt system that records all request parameters
Nine optimization techniques enabled by default with ability to disable each individually
No dependency on draft models or external selections for speculative decoding
No API key required for initial sign-up
Integrates directly with Claude Code, Codex and Cursor via MCP protocol
Unused monthly credit rolls over up to two months
Pay only for compute time; sleeping boxes bill only for storage