laude-institute / terminal-benchLinks
A benchmark for LLMs on complicated tasks in the terminal
☆691Updated this week
Alternatives and similar repositories for terminal-bench
Users that are interested in terminal-bench are comparing it to the libraries listed below
Sorting:
- Scaling Data for SWE-agents☆399Updated this week
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆309Updated last week
- Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆595Updated 6 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆541Updated last month
- Releases from OpenAI Preparedness☆860Updated 2 weeks ago
- 🐉 Loong: Synthesize Long CoTs at Scale through Verifiers.☆429Updated 2 weeks ago
- ☆166Updated last month
- An agent benchmark with tasks in a simulated software company.☆546Updated 3 weeks ago
- AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…☆404Updated this week
- τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment☆282Updated 3 weeks ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆653Updated 2 months ago
- ☆593Updated 2 weeks ago
- open source interpretability platform 🧠☆398Updated this week
- Code and Data for Tau-Bench☆834Updated 2 weeks ago
- Prompt-to-Leaderboard☆254Updated 4 months ago
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆210Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆862Updated this week
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆419Updated 2 weeks ago
- Automatic evals for LLMs☆526Updated 2 months ago
- [ICML 2025 Oral] CodeI/O: Condensing Reasoning Patterns via Code Input-Output Prediction☆547Updated 4 months ago
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆249Updated this week
- AWM: Agent Workflow Memory☆316Updated 7 months ago
- ☆404Updated last week
- A MemAgent framework that can be extrapolated to 3.5M, along with a training framework for RL training of any agent workflow.☆665Updated last month
- Agent computer interface for AI software engineer.☆109Updated last week
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆957Updated this week
- ☆803Updated 2 weeks ago
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆245Updated last month
- DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents☆380Updated last month
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆243Updated 4 months ago