The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
☆1,074Nov 16, 2026Updated this week
Alternatives and similar repositories for judgeval
Users that are interested in judgeval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official Python SDK for Eval Protocol☆110Oct 30, 2026Updated 2 weeks ago
- wip☆11Jan 9, 2026Updated 10 months ago
- ☆21Apr 22, 2026Updated 6 months ago
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,865Updated this week
- llama4_trip_planning_agent☆13Apr 5, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,539Updated this week
- ☆242Nov 10, 2026Updated last week
- ☆17May 21, 2026Updated 5 months ago
- Our library for RL environments + evals☆4,793Updated this week
- Ludic – an LLM-RL library for the era of experience☆66Aug 9, 2026Updated 3 months ago
- A framework for building robust RL environments to train aligned AI.☆195Updated this week
- ☆12Jul 17, 2024Updated 2 years ago
- ☆308Jul 1, 2026Updated 4 months ago
- Official implementation of Continual Harness (arxiv.org/abs/2605.09998) on ARC-AGI-3☆42Jul 3, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- architect-agent☆19Aug 22, 2026Updated 2 months ago
- a benchmark to evaluate the situated inductive reasoning☆20Jan 7, 2025Updated last year
- ☆19Mar 7, 2026Updated 8 months ago
- Validate database backup files before migration to prevent costly failures☆14Aug 4, 2025Updated last year
- ☆32Jul 8, 2024Updated 2 years ago
- ☆15Dec 10, 2024Updated last year
- ☆13Apr 16, 2025Updated last year
- Environments by the Prime Intellect Research Team☆141Updated this week
- Inspect: A framework for large language model evaluations☆11Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Jun 17, 2025Updated last year
- This configuration file defines a set of custom Roo Code modes designed for an advanced, agentic software development workflow. Detailed …☆12May 1, 2025Updated last year
- [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments☆31May 21, 2026Updated 5 months ago
- 🌲 A transport to filter log lines in the manner of the `debug` module☆12Jun 1, 2026Updated 5 months ago
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆580Sep 30, 2026Updated last month
- AI Observability & Evaluation☆12,343Updated this week
- The SchemaPin protocol for cryptographically signing and verifying AI agent tool schemas to prevent supply-chain attacks.☆16Nov 3, 2026Updated 2 weeks ago
- ☆12Nov 6, 2026Updated last week
- Agentic RL Training at Scale☆2,257Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Fine Tune Multimodal LLM "Idefics 2" using QLoRA.☆11Apr 20, 2024Updated 2 years ago
- `VectorMD` transforms markdown files into a semantically searchable database, leveraging vector embeddings to efficiently retrieve releva…☆11Aug 19, 2023Updated 3 years ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆1,363Jul 4, 2026Updated 4 months ago
- Open AI data scientist agent that automates complex data analysis tasks using the ReAct framework. Execute Python code locally or in the …☆190Oct 22, 2026Updated 3 weeks ago
- FrontierSmith, a new system that uses AI to synthesize open-ended coding problems at scale☆84Oct 17, 2026Updated last month
- Reference harness for the Big Finance benchmark of workflow-grounded financial-research questions☆26Updated this week
- Synthetic data curation for post-training and structured data extraction☆1,767Nov 2, 2026Updated 2 weeks ago
Are these results useful?