Alternatives and similar repositories for agentic-benchmarks

Users that are interested in agentic-benchmarks are comparing it to the libraries listed below

• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 8 months ago
• HyperPotatoNeo / RSA
  ☆77Updated 2 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 8 months ago
• SalesforceAIResearch / CodeTree
  Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
  ☆30Updated 8 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆60Updated 8 months ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆55Updated 5 months ago
• sunnweiwei / PPP-Agent
  ☆92Updated last month
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 10 months ago
• arcee-ai / DAM
  ☆55Updated last year
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆66Updated last year
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆26Updated last week
• ScalingIntelligence / codemonkeys
  ☆59Updated 10 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆51Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆47Updated 10 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 2 months ago
• asappresearch / webagents-step
  ☆41Updated last year
• allenai / infinigram-api
  ☆88Updated last week
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆94Updated 7 months ago
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆73Updated 8 months ago
• austrian-code-wizard / c3po
  ☆29Updated last week
• InternLM / SWE-Fixer
  ☆129Updated 7 months ago
• benediktstroebl / agent-evals
  ☆25Updated 6 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆19Updated last year
• kilian-group / phantom-wiki
  Python package for generating datasets to evaluate reasoning and retrieval of large language models
  ☆19Updated 2 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆31Updated 11 months ago
• miralab-ai / autoreason
  ☆40Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 9 months ago
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆100Updated 3 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 10 months ago