LiteLLMAIOpen
Open-source AI gateway unifying 100+ LLMs behind one API
LiteLLM is an open-source AI gateway that calls more than 100 large language model providers through one OpenAI-compatible interface.
Tag
11 catalogue entries use this topic; each Project's license policy is labeled separately.
Open-source AI gateway unifying 100+ LLMs behind one API
LiteLLM is an open-source AI gateway that calls more than 100 large language model providers through one OpenAI-compatible interface.
Open-source AI gateway routing 200+ providers with fallbacks
Portkey AI Gateway is an open-source gateway that routes app traffic across 200+ LLM providers with fallbacks, load balancing, caching, and guardrails.
Open-source API and AI gateway with dashboard and cloud
Tyk is an open-source API and AI gateway enforcing authentication, rate limits and analytics across REST, GraphQL, gRPC and MCP services. Teams self-host it with Docker or Kubernetes, or use the managed Tyk Cloud.
Self-hosted LLM gateway with one OpenAI-compatible API
Bifrost is a self-hosted gateway that puts every large language model call behind one OpenAI-compatible API. An application points its existing OpenAI client at the gateway, and Bifrost routes the request to whichever provider is configured, so switching models or spreading load across providers is a configuration change rather than a rewrite.
Open-source LLM observability and AI gateway for monitoring and evaluation
Helicone is an open-source observability platform and AI gateway for LLM applications. Teams point their existing OpenAI-compatible client at the Helicone gateway and every request is logged with traces, sessions, users, cost, and latency.
Self-hosted AI gateway routing LLM traffic through Envoy
Envoy AI Gateway is a self-hosted gateway that routes application traffic to 17 language model providers through one OpenAI-compatible API.
Self-hosted PaaS with deploys, analytics, and error tracking
Temps is a self-hosted deployment platform in one Rust binary with git-push deploys plus analytics, error tracking, uptime checks, email, and AI sandboxes.
Open-source LLM observability with request logging, cost tracking, and agent tracing
Spanlens is an MIT-licensed observability platform for OpenAI, Anthropic, and Gemini workloads with request logging, cost tracking, and agent tracing, added with a one-line change or a drop-in proxy.
Open-source AI gateway that traces, evaluates, and protects LLM calls
Grepture is an open-source AI gateway that sits between an app and its LLM providers to trace, evaluate, and protect every call.
Open-source proxy securing AI API keys in iOS apps with DeviceCheck
Proxed AI is an open-source proxy that keeps AI API keys off iOS devices, checking each request with Apple DeviceCheck while adding rate limits and usage tracking.
Open-source, OpenAI-compatible LLM gateway with cost and latency tracking
LLM Gateway is an open-source gateway that puts OpenAI, Anthropic, and Gemini calls behind one OpenAI-compatible API. An application keeps its existing OpenAI client and points it at the gateway, so switching providers or spreading load across them is a configuration change rather than a rewrite.