Skip to content

Backed by Y Combinator,our optimization used by

NVIDIAHugging FaceSamsungAMDModalReddit

Any Hugging Face model

Optimized, deployed and tuned to the kernel

Name the model. We host it on a dedicated endpoint for your workspace, then tune its GPU kernels.

Your model

Any model on Hugging Face, by its repository name.

Kernel tuning

Each kernel change ships only if it is faster.

Your endpoint

Deployed and hosted for your workspace only.

Serving stack

Five layers, tuned together

Each open model runs with decoding, precision and engine settings chosen for that model and its hardware.

serving stack
Supported GPUs
NVIDIA
AMD
Kernels
NVIDIACUDA
Triton
Data retention
Zero by default

Prompt caching

Prompts with the same start cost less

Caching is automatic and best effort, with no header or parameter required.

DeepSeek V4.1 Flash 1017GLM 5.3GLM 5.3 FlashQwen3.8 27BOrnith 1.5 35BDeepSeek V4.1 Flash

Per million tokens

98.8% cache hit rate

99.4% cache hit rate

98.0% cache hit rate

96.5% cache hit rate

98.2% cache hit rate

99.7% cache hit rate

Capacity

Pay as you go, reserved, dedicated or batch

One day of open model traffic: four ways to run on the same capacity.

Pay as you go

Billed per token with no subscription, on shared capacity.

Reserved capacity

Capacity held for your traffic.

Dedicated deployments

A deployment that serves your company only.

Batch

A big job on idle capacity, for less.

Quickstart

Change three values, keep your code

The API accepts Chat Completions and Messages requests.

$1 free for a new account.

# Set RIGHTNOW_API_KEY to your API key first.curl -X POST \  "https://api.rightnowai.co/v1/chat/completions" \  -H "Authorization: Bearer $RIGHTNOW_API_KEY" \  -H "Content-Type: application/json" \  -d '{    "model": "deepseek-v4-1-flash-1017",    "messages": [{"role":"user","content":"Hello"}],    "max_tokens": 16384  }'

Join the community

Ask the team directly

Join Discord (opens in a new tab)