Alternatives and similar repositories for agentic-benchmarks

Users that are interested in agentic-benchmarks are comparing it to the libraries listed below

• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆66Updated 11 months ago
• HyperPotatoNeo / RSA
  ☆73Updated 2 months ago
• austrian-code-wizard / c3po
  ☆29Updated 3 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆79Updated 7 months ago
• allenai / IFBench
  ☆90Updated 2 weeks ago
• allenai / super-benchmark
  ☆49Updated 7 months ago
• arcee-ai / DAM
  ☆55Updated last year
• safety-research / open-source-alignment-faking
  Open Source Replication of Anthropic's Alignment Faking Paper
  ☆51Updated 7 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 7 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆94Updated 6 months ago
• sunnweiwei / PPP-Agent
  ☆88Updated 3 weeks ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆31Updated 10 months ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆56Updated 4 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆44Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 9 months ago
• allenai / infinigram-api
  ☆87Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 8 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆106Updated this week
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• xlang-ai / computer-agent-arena
  Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!
  ☆50Updated 7 months ago
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆72Updated 7 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆51Updated last year
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)
  ☆72Updated last year
• character-ai / pipelining-sft
  Simple and efficient DeepSeek V3 SFT using pipeline parallel and expert parallel, with both FP8 and BF16 trainings
  ☆96Updated 4 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• InternLM / SWE-Fixer
  ☆125Updated 6 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆58Updated 7 months ago
• SalesforceAIResearch / CodeTree
  Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
  ☆29Updated 7 months ago