USD 1 free at signup.
▄███████ RightNow open models ▀██ Billed per token. ▀ ◡ ▀ ▀ ▄██▄ ▄███ ▀▀▀███ ▀▀▀██ █▀ ▀
Call it with
import OpenAI from "openai";const client = new OpenAI({ baseURL: "https://api.runinfra.ai/v1", // <- change apiKey: process.env.RUNINFRA_GATEWAY_KEY, // <- change});const response = await client.chat.completions.create({ model: "MODEL_ID", // <- change messages: [{ role: "user", content: "Hello" }], max_tokens: 16384,});
import osfrom openai import OpenAIclient = OpenAI( base_url="https://api.runinfra.ai/v1", # <- change api_key=os.environ["RUNINFRA_GATEWAY_KEY"], # <- change)response = client.chat.completions.create( model="MODEL_ID", # <- change messages=[{"role": "user", "content": "Hello"}], max_tokens=16384,)
curl https://api.runinfra.ai/v1/chat/completions \ -H "Authorization: Bearer $RUNINFRA_GATEWAY_KEY" \ -H "Content-Type: application/json" \ -d '{"model":"MODEL_ID","messages":[{"role":"user","content":"Hello"}],"max_tokens":16384}'