A generic template
{
"name": "internal-llm",
"baseURL": "https://llm.internal/v1",
"apiKey": "...",
"wire": "responses",
"defaultModel": "internal-foundation-2026-q1"
}Common integrations
- Ollama: baseURL `http://localhost:11434/v1`
- vLLM: ships a `responses` endpoint
- Together / Fireworks etc: follow their docs
- Internal gateway: wrap to match the responses shape