Alternatives and similar repositories for agentic-benchmarks

Users that are interested in agentic-benchmarks are comparing it to the libraries listed below

• austrian-code-wizard / c3po
  ☆29Updated 3 weeks ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆61Updated 8 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆71Updated 4 months ago
• allenai / IFBench
  ☆66Updated last month
• arcee-ai / DAM
  ☆54Updated 9 months ago
• allenai / infinigram-api
  ☆78Updated last week
• Tebmer / Rereading-LLM-Reasoning
  EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…
  ☆26Updated 8 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 4 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 6 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆57Updated 4 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆49Updated 10 months ago
• miralab-ai / autoreason
  ☆40Updated 8 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 7 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 6 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 6 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• du-nlp-lab / MLR-Copilot
  ☆66Updated 5 months ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆55Updated last month
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 9 months ago
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆45Updated last year
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆35Updated 10 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 11 months ago
• benediktstroebl / agent-evals
  ☆24Updated 3 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆92Updated 3 months ago
• epoch-research / training-cost-trends
  ☆19Updated 3 weeks ago
• SalesforceAIResearch / CodeTree
  Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
  ☆27Updated 5 months ago