Skip to main content
OpenSourceAlternatives

Tag

ai-gateway

11 catalogue entries use this topic; each Project's license policy is labeled separately.

LiteLLM

LiteLLMAIOpen

Open-source AI gateway unifying 100+ LLMs behind one API

Stars60.1K
Commitjust now
LicenseMIT

LiteLLM is an open-source AI gateway that calls more than 100 large language model providers through one OpenAI-compatible interface.

Alternative toBifrost
Portkey AI Gateway

Portkey AI GatewayOpen

Open-source AI gateway routing 200+ providers with fallbacks

Stars13.2K
Commit3mo ago
LicenseMIT

Portkey AI Gateway is an open-source gateway that routes app traffic across 200+ LLM providers with fallbacks, load balancing, caching, and guardrails.

Tyk

TykOpen

Open-source API and AI gateway with dashboard and cloud

Stars10.9K
Commitjust now
LicenseMPL-2.0

Tyk is an open-source API and AI gateway enforcing authentication, rate limits and analytics across REST, GraphQL, gRPC and MCP services. Teams self-host it with Docker or Kubernetes, or use the managed Tyk Cloud.

Alternative toKrakenD
Bifrost

BifrostOpen

Self-hosted LLM gateway with one OpenAI-compatible API

Stars8,531
Commitjust now
LicenseApache-2.0

Bifrost is a self-hosted gateway that puts every large language model call behind one OpenAI-compatible API. An application points its existing OpenAI client at the gateway, and Bifrost routes the request to whichever provider is configured, so switching models or spreading load across providers is a configuration change rather than a rewrite.

Helicone

HeliconeAIOpen

Open-source LLM observability and AI gateway for monitoring and evaluation

Stars6,211
Commitjust now
LicenseApache-2.0

Helicone is an open-source observability platform and AI gateway for LLM applications. Teams point their existing OpenAI-compatible client at the Helicone gateway and every request is logged with traces, sessions, users, cost, and latency.

Envoy AI Gateway

Envoy AI GatewayAIOpen

Self-hosted AI gateway routing LLM traffic through Envoy

Stars2,182
Commitjust now
LicenseApache-2.0

Envoy AI Gateway is a self-hosted gateway that routes application traffic to 17 language model providers through one OpenAI-compatible API.

Alternative toLiteLLMBifrost
Temps

TempsOpen

Self-hosted PaaS with deploys, analytics, and error tracking

Stars837
Commitjust now
LicenseApache-2.0

Temps is a self-hosted deployment platform in one Rust binary with git-push deploys plus analytics, error tracking, uptime checks, email, and AI sandboxes.

Alternative toDokployCoolify
Spanlens

SpanlensAIOpen

Open-source LLM observability with request logging, cost tracking, and agent tracing

Stars13
Commitjust now
LicenseMIT

Spanlens is an MIT-licensed observability platform for OpenAI, Anthropic, and Gemini workloads with request logging, cost tracking, and agent tracing, added with a one-line change or a drop-in proxy.

Alternative toLangfuseHelicone
Grepture

GreptureOpen

Open-source AI gateway that traces, evaluates, and protects LLM calls

Stars10
Commit5d ago
LicenseAGPL-3.0

Grepture is an open-source AI gateway that sits between an app and its LLM providers to trace, evaluate, and protect every call.

Proxed AI

Proxed AIAIOpen

Open-source proxy securing AI API keys in iOS apps with DeviceCheck

Stars8
Commitjust now
LicenseAGPL-3.0

Proxed AI is an open-source proxy that keeps AI API keys off iOS devices, checking each request with Apple DeviceCheck while adding rate limits and usage tracking.

LLM Gateway

LLM GatewayAIOpen

Open-source, OpenAI-compatible LLM gateway with cost and latency tracking

Stars2
Commit19d ago
LicenseMIT

LLM Gateway is an open-source gateway that puts OpenAI, Anthropic, and Gemini calls behind one OpenAI-compatible API. An application keeps its existing OpenAI client and points it at the gateway, so switching providers or spreading load across them is a configuration change rather than a rewrite.

Alternative toLiteLLMBifrost