Skip to content

LlamaIndex ​

LlamaIndex's OpenAI LLM and embedding classes accept a custom api_base, so the whole framework routes through Corveil with a single configuration block.

Mode ​

Direct mode only.

1. Install ​

bash
pip install llama-index llama-index-llms-openai

2. Minimal example ​

python
from llama_index.llms.openai import OpenAI

llm = OpenAI(
    model="or-claude-haiku-4.5",
    api_base="https://your-corveil-host/v1",
    api_key="sk-citadel-your-key-here",
)

resp = llm.complete("Explain RAG in one paragraph")
print(resp.text)

Embeddings ​

OpenAIEmbedding calls POST /v1/embeddings with the same api_base and api_key. An org admin first enables the model under AI Gateway → Providers → Catalog (openai/text-embedding-3-small, openai/text-embedding-3-large, or openai/text-embedding-ada-002), then clicks Add OpenAI embedding aliases under AI Gateway → Providers → Aliases.

OpenAIEmbedding expects OpenAI's own model names, so send the bare name and let the alias map it onto the catalog row.

python
from llama_index.embeddings.openai import OpenAIEmbedding

embed = OpenAIEmbedding(
    model="text-embedding-3-small",
    api_base="https://your-corveil-host/v1",
    api_key="sk-citadel-your-key-here",
)

print(embed.get_text_embedding("Explain RAG in one paragraph")[:3])

Install llama-index-embeddings-openai alongside the LLM package.

Notes ​

  • For service-level defaults, set Settings.llm = OpenAI(...) and Settings.embed_model = OpenAIEmbedding(...) once at startup