Skip to main content
Smart Routing selects the best model for each prompt automatically. Simple questions go to a fast, cost-efficient model; complex or multi-step tasks go to a more capable one. You use the same OpenAI-compatible API. Just change the model name.

Models

Use lyceum/router when you want automatic cost/quality optimisation. Use the others when you want explicit control over which tier handles your requests.

Usage

The API is identical to any other serverless inference call. Only the model name changes.
Streaming works the same way:

Score endpoint

To inspect the complexity score for a prompt without triggering a full inference request, use the score endpoint directly. It returns a value between 0 and 1. Lower means simpler, higher means more complex.
This is useful for understanding how the router classifies your prompts, or for building custom routing logic on top of the score.

Billing

Requests are billed at the rate of whichever model the router selects. lyceum/simple, lyceum/complex, and lyceum/reasoning always route to the same tier, so their cost is predictable.

Serverless Inference

Learn more about pay-per-request inference.