The LLM Evaluation Framework
☆17,595Aug 13, 2026Updated this week
Alternatives and similar repositories for deepeval
Users that are interested in deepeval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Supercharge Your LLM Application Evaluations 🚀☆15,301Feb 24, 2026Updated 5 months ago
- 🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenT…☆33,102Updated this week
- DSPy: The framework for programming—not prompting—language models☆37,168Updated this week
- AI Observability & Evaluation☆11,050Updated this week
- Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, De…☆24,205Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Universal memory layer for AI Agents☆63,253Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆56,335Updated this week
- Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations,…☆21,382Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆29,924Updated this week
- Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.☆71,502Updated this week
- Build, run, and manage agent platforms.☆41,710Updated this week
- Get your documents ready for gen AI☆64,765Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆89,048Updated this week
- AI Agent Framework, the Pydantic way☆19,292Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Evaluation and Tracking for LLM Experiments and AI Agents☆3,508Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆57,074Updated this week
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆38,372Updated this week
- Adding guardrails to large language models.☆7,284Updated this week
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,580Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆35,477Updated this week
- Structured Outputs☆15,613Updated this week
- Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictab…☆18,252Jul 12, 2026Updated last month
- LlamaIndex is the leading document agent and OCR platform☆51,638Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 🚀 The fast, Pythonic way to build MCP servers and clients.☆27,213Updated this week
- A framework for few-shot evaluation of language models.☆13,631Updated this week
- A programming framework for agentic AI☆60,403Apr 15, 2026Updated 4 months ago
- The absolute trainer to light up AI agents.☆17,482Updated this week
- Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.☆24,240Updated this week
- 🙌 OpenHands: AI-Driven Development☆84,024Updated this week
- RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to creat…☆88,380Updated this week
- 🤗 smolagents: a barebones library for agents that think in code.☆28,805Jul 21, 2026Updated 3 weeks ago
- structured outputs for llms☆13,730Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed not…☆29,063Updated this week
- AG-UI: the Agent-User Interaction Protocol. Bring Agents into Frontend Applications.☆15,312Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆26,207Updated this week
- The batteries-included agent harness.☆27,766Updated this week
- Build resilient agents.☆39,680Updated this week
- The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol☆36,760Updated this week
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆35,179Updated this week