Integrations
LlamaIndex
Use the gateway with LlamaIndex's OpenAI-compatible LLM.
Community / untested. Works via OpenAI compatibility, but is not part of the gateway's automated test suite.
Configure the OpenAI-like LLM with the gateway base URL.
from llama_index.llms.openai_like import OpenAILike
llm = OpenAILike(
api_base="https://agent-router.gaib.ai/v1",
api_key="sk-your-api-key",
model="gemini/gemini-2.5-flash",
is_chat_model=True,
)
print(llm.complete("Hello!"))