
Spro
OpenAI-compatible gateway with routing, guardrails and observability built in
Browse every available model
See who builds and hosts them
Find the right model for your task
Put up to 4 models side by side
Compare AI gateways and alternatives
Compare top models across benchmarks
Estimate what your usage will cost
What you can do with Spro
List your models on Spro and reach new customers.

AI gateway with observability, guardrails and prompt management
Portkey is an AI gateway that combines routing with observability, guardrails, governance and prompt management. Its core gateway is open source under the MIT license and can be self-hosted, and its docs describe a unified interface to 250+ models; its homepage cites 1,600+ LLMs and 3,000+ GenAI teams. Palo Alto Networks announced it would acquire Portkey on April 30, 2026 and reported closing the deal on May 29, 2026; Portkey is now the AI gateway for its Prisma AIRS platform.
The gateway covers fallbacks, automatic retries (up to 5 with exponential backoff), weighted load balancing across keys or providers, conditional routing, timeouts, circuit breakers and canary testing. On top sit request logs and traces, budget and rate limits, virtual keys, simple and semantic caching, 40+ pre-built guardrails with partner integrations such as Patronus, Pangea and AWS Bedrock Guardrails, and a hosted prompt-management product.
Pricing is by recorded logs rather than tokens. The Developer plan is free with 10,000 logs a month and 3-day log retention and is marked not suitable for production; Production is $49 a month with 100,000 logs and $9 per additional 100,000; Enterprise is custom with SSO, VPC hosting and compliance support. Some features, such as semantic caching and prompt management, are hosted or enterprise only.
Core capabilities this platform advertises.
What this tool does well, and the limitations to keep in mind.
Pros
Cons
What's included in each plan, and how the tiers compare.
$0
Free forever · not for production
$49
Per month
Custom
Talk to sales
Teams that want a gateway plus observability and governance tooling in one product.
Both are LLM gateways, with different strengths. Here is how they fit.
Where Spro can help
Where Portkey is stronger
Tools, SDKs and platforms that Portkey works with.
Common questions about Portkey.
0% markup on tokensSpro is an OpenAI-compatible gateway with failover, caching, guardrails and tracing built in, 0% markup on tokens and a free trial, so you can test it with your own traffic before deciding.
Top LLM gateways you can use instead of Portkey.

Spro
OpenAI-compatible gateway with routing, guardrails and observability built in

OpenRouter
One OpenAI-compatible API for hundreds of models from many providers

LiteLLM
Open-source Python SDK and proxy server that speaks the OpenAI format to many providers

Cloudflare AI Gateway
AI gateway that runs on Cloudflare's network

Vercel AI Gateway
One endpoint for many models, built into the Vercel platform and AI SDK

Respan
AI router with built-in observability and automated evals

Requesty
Unified AI gateway and LLM router for 600+ models

TrueFoundry
Enterprise AI gateway with governance and monitoring, deployable in your own environment

OrcaRouter
One AI gateway with adaptive routing and governance

Concentrate AI
One API to switch between every LLM, with spend controls and zero-data-retention routing

FastRouter
AI gateway with 0% markup: one OpenAI-compatible API for 200+ models
Helicone
Open-source LLM observability with an OpenAI-compatible gateway

Bifrost
Open-source AI gateway from Maxim AI, self-hostable and fast to deploy

Kong AI Gateway
AI plugins for Kong Gateway, built for teams already running Kong
Side-by-side comparisons with other gateways.
vs
Spro vs Portkey
vs
Portkey vs OpenRouter
vs
Portkey vs LiteLLM
vs
Portkey vs Cloudflare AI Gateway
vs
Portkey vs Vercel AI Gateway
vs
Portkey vs Respan
vs
Portkey vs Requesty
vs
Portkey vs TrueFoundry
vs
Portkey vs OrcaRouter
vs
Portkey vs Concentrate AI
vs
Portkey vs FastRouter
vsPortkey vs Helicone
vs
Portkey vs Bifrost
vs
Portkey vs Kong AI Gateway
One OpenAI-compatible API for 350+ models, with intelligent routing, 29 built-in guardrails, observability, and automatic failover.