Skip to main content
Inference is where you call a model you’ve already registered in Eval or trained in Train. Every deployed model gets its own OpenAI-compatible endpoint, you authenticate with a key scoped to that model and send it requests directly, from curl, your own backend, or any OpenAI-compatible client.

Get a key and call a model

Inference API Token

Issue a key from a model’s page, then call its endpoint directly.

BenchGen Router Lite

Point that same key at a router that picks the model for you per query.
Last modified on September 2, 2026