Tag
10 catalogue entries use this topic; each Project's license policy is labeled separately.
Open-source LLM observability, evals, and prompt management
Langfuse is an open-source platform for tracing, evaluating, and improving LLM applications and AI agents, with prompt management and experiments built in.
Open-source tracing, evals, and prompt tools for LLM apps
Arize Phoenix is a self-hosted observability platform for LLM apps with tracing, evaluations, datasets, and a prompt playground.
Open-source OpenTelemetry instrumentation for LLM applications
OpenLLMetry is an open-source observability library that instruments LLM applications with OpenTelemetry traces covering model calls, tool use, and retrieval steps.
Open-source LLM observability and AI gateway for monitoring and evaluation
Helicone is an open-source observability platform and AI gateway for LLM applications. Teams point their existing OpenAI-compatible client at the Helicone gateway and every request is logged with traces, sessions, users, cost, and latency.
Open-source agent observability, evals, and AI governance
LangWatch is an open-source observability and evaluation platform for AI platform teams, covering LLM operations, coding-assistant usage, AI gateway routing, and AI governance in one place.
Open-source workspace for building and running AI agents
Agenta is an open-source workspace for building and running AI agents through chat, with scheduling, approvals, versioning, and tracing.
Open-source AI agent observability that finds failures and dispatches fixes
Latitude is an open-source, MIT-licensed observability platform for production AI agents, organized around an Observe, Understand, and Refine loop of tracing, failure signals, and guardrails.
Open-source tracing, evals, and observability for AI agents
Laminar is an open-source observability platform purpose-built for AI agents, with OpenTelemetry-native tracing, evaluations, and behavior monitoring built in.
Open-source OpenTelemetry observability for LLM apps and AI agents
OpenLIT is an Apache-2.0 platform tracing and evaluating LLM apps and AI agents over OpenTelemetry, self-hosted with Docker or Kubernetes.
Open-source LLM observability with request logging, cost tracking, and agent tracing
Spanlens is an MIT-licensed observability platform for OpenAI, Anthropic, and Gemini workloads with request logging, cost tracking, and agent tracing, added with a one-line change or a drop-in proxy.