The LLM Evaluation Framework
☆19,318Nov 5, 2026Updated this week
Alternatives and similar repositories for deepeval
Users that are interested in deepeval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Supercharge Your LLM Application Evaluations 🚀☆16,247Feb 24, 2026Updated 8 months ago
- 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.☆37,056Updated this week
- DSPy: The framework for programming—not prompting—language models☆38,904Updated this week
- AI Observability & Evaluation☆12,160Updated this week
- Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, De…☆26,872Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.☆68,433Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆62,772Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆32,514Updated this week
- Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations,…☆23,199Updated this week
- The self-driving agent platform☆43,072Updated this week
- How Python does AI. Agents, realtime voice, image generation, embeddings. Every model, every interface, typed end to end.☆21,036Updated this week
- LlamaIndex is the document processing platform for AI☆52,820Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,063Updated this week
- Get your documents ready for gen AI☆70,126Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,396Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆60,537Updated this week
- A programming framework for agentic AI☆61,713Oct 28, 2026Updated last week
- Evaluation and Tracking for LLM Experiments and AI Agents☆3,628Updated this week
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆39,263Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆26,927Updated this week
- Adding guardrails to large language models.☆7,585Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆36,569Updated this week
- structured outputs for llms☆14,098Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🚀 The fast, Pythonic way to build MCP servers and clients.☆28,318Updated this week
- Structured Outputs☆16,003Sep 21, 2026Updated last month
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,839Updated this week
- The batteries-included agent harness.☆31,008Updated this week
- A framework for few-shot evaluation of language models.☆14,407Updated this week
- 🙌 OpenHands: AI-Driven Development☆92,721Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆15,680Updated this week
- Parlant is an open platform for building customer-facing chat agents with AI. Describe how the agent should behave, and your coding agent…☆18,325Updated this week
- RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.☆93,604Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- The agent engineering platform.☆149,083Updated this week
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆19,709Apr 14, 2026Updated 6 months ago
- Build resilient agents.☆44,484Updated this week
- Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.☆25,357Oct 18, 2026Updated 2 weeks ago
- The absolute trainer to light up AI agents.☆18,905Updated this week
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆39,963Updated this week
- 🤗 smolagents: a barebones library for agents that think in code.☆30,219Updated this week