RoutingComing soon

Automatic model selection

Let the gateway choose the model for each request, based on the task, cost and quality rules you set.

Coming soonChosen per requestCost and quality rules

What is Automatic model selection?

Automatic model selection is a gateway feature where the router picks which model answers each request, instead of your code naming one fixed model. The choice follows rules such as task type, cost limits and quality targets. You send one auto model name, and the gateway picks a suitable model for each call.

Most apps use one model for everything. That wastes money on simple requests and can under-serve hard ones. Automatic selection moves that decision into the gateway, so each request goes to a model that fits its difficulty and budget.

This page describes planned behaviour. The selection rules and their results will be published with the feature, and request logs will record the model that answered each call.

Key features

What this feature does for your requests.

  • One auto model name in your requests
  • Choice based on task type, cost and quality rules
  • Cost ceilings so cheaper models handle simple work
  • The chosen model is recorded on every request

How it works

4 steps, from setup to the first request.

  1. 01

    Send the auto model name

    Use the auto model in place of a fixed model name.

  2. 02

    Set the rules

    Choose cost and quality preferences for the workspace.

  3. 03

    Requests route automatically

    The gateway picks a model for each request.

  4. 04

    Review the choices

    Request logs show the model picked and what it cost.

Is it the right fit?

Specific situations where this feature helps, and where it does not.

Good fit if

  • Simple and complex requests share one app and should not all pay frontier prices
  • You want model choice tuned by rules instead of per-feature code
  • A cost ceiling matters more than picking one model for every call

Not a good fit if

  • Every request must use one model for compliance or consistent output
  • You cannot test answer quality on your own data before traffic moves
  • Your traffic is uniform, so one fixed model is already the right choice

Automatic model selection FAQs

Common questions about Automatic model selection.

Route every AI request through SPRO.

One OpenAI-compatible API for 350+ models, with intelligent routing, 29 built-in guardrails, observability, and automatic failover.

Talk to sales