Sambanova

Use Sambanova models with Agno agents.

Sambanova is a platform for providing endpoints for Large Language models. Note that Sambanova currently does not support function calling.

Authentication

Set your SAMBANOVA_API_KEY environment variable. Get your key from here.

Mac

export SAMBANOVA_API_KEY=***

setx SAMBANOVA_API_KEY ***

Example

Use Sambanova with your Agent:

agent.py

from agno.agent import Agent
from agno.models.sambanova import Sambanova

agent = Agent(model=Sambanova(), markdown=True)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")

Params

Parameter	Type	Default	Description
id	str	"Meta-Llama-3.1-8B-Instruct"	The id of the SambaNova model to use
name	str	"SambaNova"	The name of the model
provider	str	"SambaNova"	The provider of the model
api_key	Optional[str]	None	The API key for SambaNova (defaults to SAMBANOVA_API_KEY env var)
base_url	str	"https://api.sambanova.ai/v1"	The base URL for the SambaNova API

Sambanova also supports the params of OpenAI.