Portkey

Use Portkey AI Gateway for multi-provider routing with Agno agents.

Portkey is an AI Gateway that provides a unified interface to access multiple AI providers with advanced features like routing, load balancing, retries, and observability. Use Portkey to build production-ready AI applications with better reliability and cost optimization.

With Portkey, you can:

• Route requests across multiple AI providers
• Implement fallback mechanisms for better reliability
• Monitor and analyze your AI usage
• Cache responses for cost optimization
• Apply rate limiting and usage controls

Authentication

You need both a Portkey API key and a virtual key for model routing. Get them from Portkey here.

Mac

export PORTKEY_API_KEY=***
export PORTKEY_VIRTUAL_KEY=***

setx PORTKEY_API_KEY ***
setx PORTKEY_VIRTUAL_KEY ***

Example

Use Portkey with your Agent:

agent.py

from agno.agent import Agent
from agno.models.portkey import Portkey

agent = Agent(
    model=Portkey(id="gpt-5-mini"),
    markdown=True
)

# Print the response in the terminal
agent.print_response("What is Portkey and why would I use it as an AI gateway?")

Advanced Configuration

You can configure Portkey with custom routing and retry policies:

from agno.agent import Agent
from agno.models.portkey import Portkey

config = {
    "strategy": {
        "mode": "fallback"
    },
    "targets": [
        {"virtual_key": "openai-key"},
        {"virtual_key": "anthropic-key"}
    ]
}

agent = Agent(
    model=Portkey(
        id="gpt-5-mini",
        config=config,
    ),
)

View more examples here.

Params

Parameter	Type	Default	Description
id	str	"gpt-4o-mini"	The id of the model to use through Portkey
name	str	"Portkey"	The name of the model
provider	str	"Portkey"	The provider of the model
portkey_api_key	Optional[str]	None	The API key for Portkey (defaults to PORTKEY_API_KEY env var)
base_url	str	"https://api.portkey.ai/v1"	The base URL for the Portkey API
virtual_key	Optional[str]	None	The virtual key for the underlying provider
config	Optional[Dict[str, Any]]	None	Portkey configuration (routing, retries, etc.)

Portkey also supports the params of OpenAI.

The base_url parameter is the endpoint for the Portkey AI Gateway. Default value is “https://api.portkey.ai/v1” for the standard managed Portkey service.

You only need to specify this if you are using a self-hosted instance of Portkey or a specific enterprise endpoint.