Alternatives and similar repositories for agent-evals

Users that are interested in agent-evals are comparing it to the libraries listed below

• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• arcee-ai / DAM
  ☆54Updated 11 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆51Updated 11 months ago
• HyperPotatoNeo / RSA
  ☆47Updated last week
• yueqis / API-Based-Agent
  ☆56Updated 3 months ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆55Updated 2 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆40Updated 8 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆56Updated 5 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆24Updated 2 weeks ago
• Tebmer / Rereading-LLM-Reasoning
  EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…
  ☆27Updated 9 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 8 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 5 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated 2 years ago
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 5 months ago
• du-nlp-lab / MLR-Copilot
  ☆67Updated 6 months ago
• Aloriosa / srmt
  The original Shared Recurrent Memory Transformer implementation
  ☆31Updated 2 months ago
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆34Updated 4 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆37Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 8 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆64Updated 9 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆74Updated 5 months ago
• asappresearch / webagents-step
  ☆41Updated last year
• benpry / why-think-step-by-step
  Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"
  ☆61Updated 6 months ago
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆24Updated 4 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆115Updated 5 months ago
• dinobby / MAgICoRE
  ☆23Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆103Updated 5 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 10 months ago