laude-institute / terminal-benchLinks
A benchmark for LLMs on complicated tasks in the terminal
☆1,260Updated this week
Alternatives and similar repositories for terminal-bench
Users that are interested in terminal-bench are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆492Updated this week
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆396Updated this week
- τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment☆572Updated last week
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆607Updated 4 months ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆637Updated 9 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,407Updated this week
- OpenAI Frontier Evals☆966Updated 3 weeks ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆748Updated 5 months ago
- Code and Data for Tau-Bench☆1,033Updated 4 months ago
- ☆617Updated 3 months ago
- Post-training with Tinker☆2,617Updated this week
- Async RL Training at Scale☆960Updated this week
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆461Updated 2 months ago
- ☆299Updated 3 months ago
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆405Updated last month
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,236Updated last week
- An agent benchmark with tasks in a simulated software company.☆611Updated last month
- AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…☆488Updated last week
- Harbor is a framework for running agent evaluations and creating and using RL environments.☆241Updated this week
- ☆1,369Updated 3 months ago
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆871Updated this week
- Automatic evals for LLMs☆569Updated this week
- Scalable toolkit for efficient model reinforcement☆1,171Updated this week
- Seed-Coder is a family of lightweight open-source code LLMs comprising base, instruct and reasoning models, developed by ByteDance Seed.☆716Updated 6 months ago
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆294Updated last week
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆231Updated last week
- An Open-Source Large-Scale Reinforcement Learning Project for Search Agents☆514Updated last month
- A clean, modular SDK for building AI agents with OpenHands V1.☆360Updated this week
- The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—b…☆2,385Updated this week
- A MemAgent framework that can be extrapolated to 3.5M, along with a training framework for RL training of any agent workflow.☆844Updated 4 months ago