The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
☆1,063Sep 16, 2026Updated this week
Alternatives and similar repositories for judgeval
Users that are interested in judgeval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Dec 10, 2024Updated last year
- Some basic libraries for Coq.☆14Sep 9, 2025Updated last year
- Counterfactual Evaluation and Learning for Interactive Systems: Foundations, Implementations, and Recent Advances☆12Aug 14, 2022Updated 4 years ago
- ACL 2026 & NAACL 2025: Bridging Retrieval and Inference through Evidence Fusion☆14Apr 9, 2026Updated 5 months ago
- Tinker ↔ KernelBench Integration enabling RL for GPU Kernel Generation☆31Mar 5, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official code for the paper "Contrastive Representations for Temporal Reasoning".☆58Nov 25, 2025Updated 9 months ago
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16May 3, 2022Updated 4 years ago
- Code related to different aspects of conformal learning☆18Jan 28, 2025Updated last year
- AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse A…☆25Jan 26, 2026Updated 7 months ago
- WONDERBREAD benchmark + dataset for BPM tasks☆35Jul 30, 2025Updated last year
- Scalable, cloud-native infrastructure for evaluating AI agents across any benchmark.☆37Updated this week
- Handwritten text recognition with TensorFlow☆10Aug 3, 2024Updated 2 years ago
- (WSDM2022 Best Paper Award Runner-Up) "Doubly Robust Off-Policy Evaluation for Ranking Policies under the Cascade Behavior Model"☆13Jul 16, 2023Updated 3 years ago
- ☆32Jul 8, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆18May 18, 2025Updated last year
- ☆241Jan 5, 2026Updated 8 months ago
- Starter kit for getting started in the NIPS 2017 Criteo Ad Placement Challenge☆18Nov 10, 2017Updated 8 years ago
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,751Updated this week
- ☆12Jul 4, 2022Updated 4 years ago
- [ICLR 2025] No Preference Left Behind: Group Distributional Preference Optimization☆16Apr 21, 2025Updated last year
- (ICTIR2020) "Unbiased Pairwise Learning from Biased Implicit Feedback"☆19Nov 21, 2022Updated 3 years ago
- Lean coding problem solving challenge website with proof verification☆13Jul 8, 2025Updated last year
- Surface crack images classification using PyTorch Lightning☆11Jun 17, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Class instances for Coq inductive types with little boilerplate☆27Updated this week
- ☆91Oct 2, 2023Updated 2 years ago
- ☆23Jan 3, 2025Updated last year
- SMS Client for Twitter DMs☆11Jul 6, 2020Updated 6 years ago
- CODA: Coordinating the Cerebrum and Cerebellum for a Dual-Brain Computer Use Agent with Decoupled Reinforcement Learning☆37Aug 28, 2025Updated last year
- An example repository for getting started with the Agent Inbox and LangGraph.js☆24Jul 15, 2026Updated 2 months ago
- Make tool-calling schemas for existing tools☆14Mar 8, 2025Updated last year
- Building self-refined guardrails via DSPy☆15Jun 25, 2026Updated 2 months ago
- Openwater's Open-Source Neuromodulation Software☆30Aug 23, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆21Jul 23, 2023Updated 3 years ago
- An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, …☆52Mar 25, 2026Updated 5 months ago
- A Model Context Protocol server for Python code analysis with Claude. Again, works with warning now. I'm missing something here.☆11Nov 29, 2025Updated 9 months ago
- Ranking LLMs on agentic tasks☆226May 21, 2026Updated 3 months ago
- A Python Natural Language Processing Toolkit for Electronic Health Record Texts☆13May 24, 2023Updated 3 years ago
- ☆15Oct 28, 2018Updated 7 years ago
- AgentOS: Serve agents over API, MCP, and chat interfaces like Slack☆34Aug 31, 2026Updated 2 weeks ago