The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
☆1,071Oct 27, 2026Updated this week
Alternatives and similar repositories for judgeval
Users that are interested in judgeval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆39Oct 6, 2026Updated 3 weeks ago
- Turn Apple's CVPR-25 FastVLM encoder into a reproducible baseline for mobile apps. First complete implementation achieving <250ms multimo…☆12Mar 19, 2026Updated 7 months ago
- wip☆11Jan 9, 2026Updated 9 months ago
- A framework for building robust RL environments to train aligned AI.☆160Updated this week
- llama4_trip_planning_agent☆13Apr 5, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- MMdetection fork with new vision☆11Mar 6, 2026Updated 7 months ago
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,823Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,462Updated this week
- Run a coding model at 300+ tok/s on your Mac. Native Rust + Metal inference engine for LiquidAI LFM2.5-24B-A2B (MLX 4-bit) on Apple Silic…☆22Updated this week
- Our library for RL environments + evals☆4,748Updated this week
- a benchmark to evaluate the situated inductive reasoning☆20Jan 7, 2025Updated last year
- ☆11Jun 15, 2019Updated 7 years ago
- This configuration file defines a set of custom Roo Code modes designed for an advanced, agentic software development workflow. Detailed …☆12May 1, 2025Updated last year
- Ludic – an LLM-RL library for the era of experience☆66Aug 9, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Validate database backup files before migration to prevent costly failures☆14Aug 4, 2025Updated last year
- ☆242Jan 5, 2026Updated 9 months ago
- ☆308Jul 1, 2026Updated 3 months ago
- architect-agent☆19Aug 22, 2026Updated 2 months ago
- ☆19Mar 7, 2026Updated 7 months ago
- ☆15Dec 10, 2024Updated last year
- Preference-based Prompt Optimization: Iteratively improve LLM prompts using pairwise comparison and judge feedback☆10May 12, 2026Updated 5 months ago
- ☆13Apr 16, 2025Updated last year
- A collection of small projects to show how to use ArcadeDB☆13Oct 19, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Grakn Core: The Knowledge Graph☆12Apr 3, 2019Updated 7 years ago
- Efficient retrieval head analysis with triton flash attention that supports topK probability☆13Jun 15, 2024Updated 2 years ago
- Production-ready Cloud Run service wrapping Claude Code CLI with dynamic MCP server configuration and SSE streaming☆15Feb 18, 2026Updated 8 months ago
- The SchemaPin protocol for cryptographically signing and verifying AI agent tool schemas to prevent supply-chain attacks.☆16Oct 11, 2026Updated 2 weeks ago
- Agentic RL Training at Scale☆2,201Updated this week
- Fine Tune Multimodal LLM "Idefics 2" using QLoRA.☆11Apr 20, 2024Updated 2 years ago
- `VectorMD` transforms markdown files into a semantically searchable database, leveraging vector embeddings to efficiently retrieve releva…☆11Aug 19, 2023Updated 3 years ago
- Get start with RL, today☆17Sep 9, 2025Updated last year
- FrontierSmith, a new system that uses AI to synthesize open-ended coding problems at scale☆84Oct 17, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆23Nov 26, 2025Updated 11 months ago
- Synthetic data curation for post-training and structured data extraction☆1,756Updated this week
- Procedural data generators for verifiable reasoning, synthetic pretraining, post-training, evaluation, and RL.☆52Updated this week
- Open, self-hosted runtime for real-time voice agents — a Rust recreation of ChatGPT's Advanced Voice Mode (GPT-Live), model-neutral☆37Aug 28, 2026Updated 2 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆1,359Jul 4, 2026Updated 3 months ago
- mdpre - Markdown Preprocessor☆13Oct 2, 2026Updated 3 weeks ago
- Scalable toolkit for efficient model reinforcement☆2,092Updated this week