ChatOpenRouter
ChatOpenRouter(=None,
system_prompt=None,
model=None,
api_key='https://openrouter.ai/api/v1',
base_url=MISSING,
seed=None,
kwargs )
Chat with one of the many models hosted on OpenRouter.
OpenRouter provides access to a wide variety of language models from different providers through a unified API. Support for features depends on the underlying model that you use.
Prerequisites
Sign up at https://openrouter.ai to get an API key.
Examples
import os
from chatlas import ChatOpenRouter
= ChatOpenRouter(api_key=os.getenv("OPENROUTER_API_KEY"))
chat "What is the capital of France?") chat.chat(
Parameters
Name | Type | Description | Default |
---|---|---|---|
system_prompt | Optional[str] | A system prompt to set the behavior of the assistant. | None |
model | Optional[str] | The model to use for the chat. The default, None, will pick a reasonable default, and warn you about it. We strongly recommend explicitly choosing a model for all but the most casual use. See https://openrouter.ai/models for available models. | None |
api_key | Optional[str] | The API key to use for authentication. You generally should not supply this directly, but instead set the OPENROUTER_API_KEY environment variable. |
None |
base_url | str | The base URL to the endpoint; the default uses OpenRouter’s API. | 'https://openrouter.ai/api/v1' |
seed | Optional[int] | MISSING_TYPE | Optional integer seed that the model uses to try and make output more reproducible. | MISSING |
kwargs | Optional['ChatClientArgs'] | Additional arguments to pass to the openai.OpenAI() client constructor. |
None |
Returns
Name | Type | Description |
---|---|---|
Chat | A chat object that retains the state of the conversation. |
Note
This function is a lightweight wrapper around ChatOpenAI
with the defaults tweaked for OpenRouter.
Note
Pasting an API key into a chat constructor (e.g., ChatOpenRouter(api_key="...")
) is the simplest way to get started, and is fine for interactive use, but is problematic for code that may be shared with others.
Instead, consider using environment variables or a configuration file to manage your credentials. One popular way to manage credentials is to use a .env
file to store your credentials, and then use the python-dotenv
package to load them into your environment.
pip install python-dotenv
# .env
OPENROUTER_API_KEY=...
from chatlas import ChatOpenRouter
from dotenv import load_dotenv
load_dotenv()= ChatOpenRouter()
chat chat.console()
Another, more general, solution is to load your environment variables into the shell before starting Python (maybe in a .bashrc
, .zshrc
, etc. file):
export OPENROUTER_API_KEY=...