OpenLLMetry
VerifiedOpen-source observability for GenAI/LLM applications based on OpenTelemetry. Instruments LLM providers, vector DBs, and frameworks with 7,200+ GitHub stars.
Frameworks Covered
Services
llm-observabilitytracingmetricsopentelemetry
About OpenLLMetry
OpenLLMetry is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. It connects to existing observability solutions like Datadog, Honeycomb, and others via standard OpenTelemetry data.
Supported Integrations
- LLM Providers: OpenAI, Anthropic, Cohere, Google Gemini, AWS Bedrock, Mistral, HuggingFace, Ollama, Replicate, Together AI, Vertex AI
- Vector DBs: Chroma, Pinecone, Qdrant, Weaviate, Milvus, LanceDB
- Frameworks: LangChain, LlamaIndex, LiteLLM
Installation
pip install opentelemetry-instrumentation-openai
Loading reviews...