All open source
Open SourceAnalytics6k

OpenLLMetry

OpenTelemetry-based observability for LLMs, vector DBs, and agent frameworks.

OpenLLMetry, from Traceloop, is a set of open-source extensions built on OpenTelemetry that add full visibility into LLM applications. It auto-instruments providers like OpenAI and Anthropic, vector databases, and frameworks such as LangChain and LlamaIndex, then exports standard OTel traces to any compatible backend. Because it is non-proprietary, telemetry can be sent to Datadog, Grafana, Honeycomb, or Traceloop itself.

Repository

traceloop/openllmetry

Language

Python

What you'd build with it

  • Add LLM and vector-DB tracing to an app with a few lines using OpenTelemetry
  • Ship token, cost, and latency spans to an existing OTel backend like Grafana or Datadog
  • Standardize agent observability across frameworks without vendor lock-in

Tags

llm-observabilityopentelemetrytracinginstrumentation