OpenLIT
VerifiedOpen-source AI engineering platform with OpenTelemetry-native LLM observability, GPU monitoring, guardrails, evaluations, and prompt management. Integrates with 50+ providers.
Frameworks Covered
Services
llm-observabilitygpu-monitoringguardrailsevaluationsprompt-management
About OpenLIT
OpenLIT is an open-source platform for AI engineering that provides OpenTelemetry-native LLM observability, GPU monitoring, guardrails, evaluations, prompt management, vault, and playground. It auto-instruments 44+ LLM providers, AI frameworks, and vector databases with a single line of code.
Features
- OpenTelemetry-native observability SDKs (Python, TypeScript, Go)
- 11 built-in evaluation types (hallucination, bias, toxicity, safety, faithfulness)
- Rule engine with AND/OR logic for runtime trace attributes
- Prompt management with versioning
- GPU monitoring
- Exceptions monitoring dashboard
- Fleet Hub for OpAMP management
Installation
pip install openlit
Loading reviews...