LiteLLM SDK / Proxy

LiteLLM can speak to any OpenAI-compatible endpoint, so it can sit in front of Corveil if you already have a LiteLLM-based pipeline. (For most use cases Corveil is sufficient on its own — this entry is for teams already invested in LiteLLM.)

Mode

Direct mode only.

Python SDK

from litellm import completion

resp = completion(
    model="openai/or-claude-haiku-4.5",
    api_base="https://your-corveil-host/v1",
    api_key="sk-citadel-your-key-here",
    messages=[{"role": "user", "content": "Hello from LiteLLM via Corveil"}],
)
print(resp.choices[0].message["content"])

The openai/ prefix tells LiteLLM to treat the upstream as an OpenAI-compatible endpoint — the rest of the string is whatever model ID your Corveil instance exposes.

LiteLLM Proxy config

If you're running the LiteLLM Proxy and want to fan one or more model entries through Corveil, add it as an OpenAI-compatible model:

model_list:
  - model_name: corveil-haiku
    litellm_params:
      model: openai/or-claude-haiku-4.5
      api_base: https://your-corveil-host/v1
      api_key: sk-citadel-your-key-here