Private AI inference and confidential GPU computing infrastructure
Compress prompts and reduce LLM API costs while preserving answers
Stage
Not given
Startup
Founded
Not given
2024
Based in
US
Not given
Pricing model
Paid
Free
Pricing
Confidential Inference: DeepSeek V4.1 Flash $0.30 input and $1.20 output per 1M tokens; Kimi K3 $3.00 input and $15.00 output per 1M tokens; GLM 5.3 $1.40 input and $4.40 output per 1M tokens; Qwen3.8 27B $0.30 input and $1.80 output per 1M tokens. Confidential VMs: B300 at $7.50 per GPU-hour, B200
Open beta: $0/month with unlimited API calls, all features, and no credit card required. After beta: a generous free tier and simple usage plans with early users keeping their perks.
Key features
OpenAI-compatible endpoint for private LLM inference
Hardware-encrypted VMs on Intel TDX, AMD SEV-SNP and NVIDIA GPUs
Client attestation verification before sending requests
Support for multiple open-weight models including DeepSeek, Kimi, GLM, Qwen
Confidential Kubernetes for data center scale deployments
Confidential training and fine-tuning on licensed stack
Root access over SSH to confidential VMs
Encrypted GPU communications with NVLink encryption on B200 and B300
Confidential agents runtime support
Prompt caching with cached input billing
Compress long prompts, logs and documents by removing filler while preserving code, numbers and facts
Convert web pages to clean Markdown instead of raw HTML
Shrink JSON responses into TOON format with headers and CSV-like rows
Available as MCP server for Claude, Cursor, Windsurf and VS Code
Gateway integration for OpenAI and Anthropic SDKs
REST API for direct integration
Self-hosted or hosted gateway options
Dashboard showing token and cost savings
Works with any chat model including local models
Output modes to control answer verbosity: lite, caveman and ultra
What makes it different
Prompts and model weights verified by clients with cryptographic attestation before any data is sent
Operator-blind inference: data remains unreadable to the company and hosting provider
Flexible deployment: choice of hosted cloud, rented VMs, or licensed stack on own infrastructure
Open-weight models only, no closed-source frontier models
Full cryptographic verification stack including open-source tools
Rule-based compression takes milliseconds without using another LLM
Your API key never leaves your infrastructure when using self-hosted gateway
Streaming, tool calling and function calling work unchanged
Real-world savings up to 42% on monthly LLM bills according to calculator
Confidential AI
AgentReady