Automatic model selection
Let the gateway choose the model for each request, based on the task, cost and quality rules you set.
What is Automatic model selection?
Automatic model selection is a gateway feature where the router picks which model answers each request, instead of your code naming one fixed model. The choice follows rules such as task type, cost limits and quality targets. You send one auto model name, and the gateway picks a suitable model for each call.
Most apps use one model for everything. That wastes money on simple requests and can under-serve hard ones. Automatic selection moves that decision into the gateway, so each request goes to a model that fits its difficulty and budget.
This page describes planned behaviour. The selection rules and their results will be published with the feature, and request logs will record the model that answered each call.
Key features
What this feature does for your requests.
- One auto model name in your requests
- Choice based on task type, cost and quality rules
- Cost ceilings so cheaper models handle simple work
- The chosen model is recorded on every request
How it works
4 steps, from setup to the first request.
- 01
Send the auto model name
Use the auto model in place of a fixed model name.
- 02
Set the rules
Choose cost and quality preferences for the workspace.
- 03
Requests route automatically
The gateway picks a model for each request.
- 04
Review the choices
Request logs show the model picked and what it cost.
Is it the right fit?
Specific situations where this feature helps, and where it does not.
Good fit if
- Simple and complex requests share one app and should not all pay frontier prices
- You want model choice tuned by rules instead of per-feature code
- A cost ceiling matters more than picking one model for every call
Not a good fit if
- Every request must use one model for compliance or consistent output
- You cannot test answer quality on your own data before traffic moves
- Your traffic is uniform, so one fixed model is already the right choice
Automatic model selection FAQs
Common questions about Automatic model selection.
Route every AI request through SPRO.
One OpenAI-compatible API for 350+ models, with intelligent routing, 29 built-in guardrails, observability, and automatic failover.
