Deepchecks
AnalyticsEvaluate, test, and monitor generative models and agents
Deepchecks is an enterprise-grade platform for testing, evaluating, and monitoring large language models and production AI systems with robust security.
Evaluate multiple machine learning outputs in one view
OverallGPT lets users run prompts across multiple machine learning models simultaneously, displaying replies in parallel columns for direct comparison.
Distributional
AnalyticsStatistical evaluation and behavioral analytics for enterpri
Distributional is a risk management platform that provides statistical testing and behavioral analytics to help enterprises evaluate production AI models.
Compare multiple chat models side-by-side
Compare ChatGPT, Claude, and Gemini side-by-side in one interface. Evaluate quality, cost, and speed to pick the best model for every task.
Measure and build emotionally intelligent voice models
Hume AI provides evaluation suites, APIs, and datasets to measure emotional expression in voice interactions across dozens of languages and emotions.
Data infrastructure for AI agents
Context Data provides a data infrastructure layer for AI agents, offering runtime governance, caching, evaluation intelligence, and distributed tracing.
Build and manage data engines and models for enterprises
Scale provides data infrastructure and machine learning portfolios for organizations to build reliable models, evaluate outputs, and deploy intelligence.
Open-source gateway and optimization toolkit for LLM apps
TensorZero offers open-source infrastructure for production LLM applications, including a gateway, observability, optimization, and evaluations.
Track models and evaluate multi-step AI agents
Comet provides comprehensive model evaluation, experiment tracking, and observability tools for developers building machine learning systems and agents.
Trace, evaluate, and test AI agents locally
Phoenix is an open-source observability platform built for developers to trace steps, run evaluations, and test changes in AI models and workflows.
Open source observability and evaluation for large language
Langfuse provides open source tracing, evaluation, and prompt management for large language model applications to monitor costs, latency, and quality.
Featured in: Langfuse vs LangSmith for Reviewing LLM Traces
Featured in: How to Review a First LLM Trace with Langfuse
Build, evaluate, and optimize systems
Kiln AI is a workbench for teams to build, evaluate, fine-tune, and optimize models using an open-source Python library and desktop application.
Build, test, deploy, and monitor production AI agents
LangSmith provides complete infrastructure and observability for developers to build, test, deploy, monitor, and govern production AI agents.
Featured in: Langfuse vs LangSmith for Reviewing LLM Traces
Test and evaluate LLM prompts across multiple models
LangFast is an online LLM playground for rapid prompt testing, side-by-side model comparison, version control, and performance tracking.