Open-source, OpenAI-compatible LLM gateway with cost and latency tracking
Stars2
Commit19d ago
LicenseMIT
LLM Gateway is an open-source gateway that puts OpenAI, Anthropic, and Gemini calls behind one OpenAI-compatible API. An application keeps its existing OpenAI client and points it at the gateway, so switching providers or spreading load across them is a configuration change rather than a rewrite.