TruLens
Metrics as of , from the GitHub or GitLab API of each repository. Refreshed monthly.
What TruLens is
TruLens is a Python library for tracing and evaluating LLM applications and agents. A decorator instruments application code, and each function call, LLM generation, retrieval and tool invocation becomes an OpenTelemetry span. Traces export to OTLP-compatible backends such as Jaeger, Grafana Tempo or Datadog. LLM judges score each step, with dedicated evaluators for agent behaviour such as plan adherence and tool selection. Evaluations run inline while the app executes or in batch over a stored dataset. A leaderboard compares app versions by score, latency and cost. Provider packages cover OpenAI, LiteLLM, Google Gemini, AWS Bedrock, Snowflake Cortex, Hugging Face and LangChain. App integrations exist for LangChain, LangGraph and LlamaIndex.
Written from the project's README, read .
- Category
- AI and LLM evaluation
- License
- MIT
- Language
- Python
- Changelog
- Releases on GitHub
Repository metrics
Status
activeLast commit within 90 days of the fetch date.Computed from the last commit date and the archive flag on the fetch date. See the status rules.
Alternatives
Listed AI and LLM evaluation tools, same primary language first, then by GitHub stars. Each line gives one fact from the tool's documentation where it differs from TruLens's, with its source.
OpenAI Evals: Model providers: Models on the OpenAI API; completion functions in evals/registry/completion_fns or any CompletionFn implementation. source: Docs: How to run evals
DeepEval: Model providers: OpenAI, Azure OpenAI, Ollama, Anthropic, Gemini, LiteLLM; custom models through DeepEvalBaseLLM. source: Docs: Introduction to LLM Metrics
Ragas: Model providers: OpenAI, Anthropic, Google directly; Azure OpenAI, AWS Bedrock, Google Vertex AI and others through LiteLLM. source: Docs: Customise models
Language Model Evaluation Harness: Model providers: Hugging Face transformers, vLLM, SGLang, GGUF via llama.cpp, NeMo, Megatron-LM; OpenAI, Anthropic, LiteLLM, local API servers. source: README
garak: Model providers: Hugging Face, Replicate, OpenAI, AWS Bedrock, LiteLLM, Cohere, Groq, NIM, ggml/GGUF, REST endpoints. source: README
Giskard: Model providers: Provider SDK extras such as openai and anthropic; default judge model openai/gpt-4o-mini. source: README
HELM: Model providers: Models from various providers through one interface, such as OpenAI, Anthropic Claude, Google Gemini. source: README
Inspect: Model providers: OpenAI, Anthropic, Google, Grok, Mistral, DeepSeek; AWS Bedrock, Azure AI; Groq, Together AI; local models. source: Docs: Model Providers
How to install
pip install trulensQuestions
Is TruLens open source?
Yes. TruLens is released under MIT, an OSI-approved license, as reported by the GitHub API on 2026-09-22.
Is TruLens maintained?
On 2026-09-22, the last commit to the default branch was on 2026-09-22, so the listed status is active. Rule: Last commit within 90 days of the fetch date.
How many GitHub stars does TruLens have?
3,570 stars on 2026-09-22, from the GitHub API. The number is refreshed at each monthly update.
What language is TruLens written in?
The repository's primary language, as reported by the GitHub API, is Python.
How do I install TruLens?
The README gives this command: pip install trulens
Sources
- GitHub REST API: repository, read
- GitHub REST API: commits, read
- GitHub REST API: latest release, read
- GitHub REST API: contributors, read
- README, read