OpenAIEmbeddingProvider

OpenAI embedding provider using text-embedding models.

Usage

OpenAIEmbeddingProvider()

Parameters

model_name: str = "text-embedding-3-small"

Name of the OpenAI model.

api_key: str = ""

OpenAI API key.

Methods

Name	Description
calculate_token_usage()	Calculate total token usage for a list of texts.
generate_embeddings_batch()	Generate embeddings in batches to handle rate limits.

---

calculate_token_usage()

Calculate total token usage for a list of texts.

Usage

calculate_token_usage(texts)

---

generate_embeddings_batch()

Generate embeddings in batches to handle rate limits.

Usage

generate_embeddings_batch(texts, batch_size=100)