Alternatives and similar repositories for agent-evals

Users that are interested in agent-evals are comparing it to the libraries listed below

• HyperPotatoNeo / RSA
  ☆76Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• du-nlp-lab / MLR-Copilot
  ☆67Updated 8 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 7 months ago
• Tebmer / Rereading-LLM-Reasoning
  EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…
  ☆27Updated 11 months ago
• arcee-ai / DAM
  ☆55Updated last year
• uq-project / UQ
  UQ: Assessing Language Models on Unsolved Questions
  ☆29Updated 3 months ago
• sunnweiwei / PPP-Agent
  ☆88Updated last month
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 10 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated 2 years ago
• dinobby / MAgICoRE
  ☆24Updated last year
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆55Updated 4 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆66Updated 11 months ago
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆39Updated 6 months ago
• yueqis / API-Based-Agent
  ☆62Updated 5 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆110Updated 7 months ago
• allenai / infinigram-api
  ☆87Updated this week
• gangiswag / infogent
  ☆23Updated 9 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆38Updated last year
• metal-chart-generation / metal
  ☆41Updated 6 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆60Updated 7 months ago
• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆23Updated last year
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆51Updated last year
• miralab-ai / autoreason
  ☆40Updated 11 months ago
• Aloriosa / srmt
  The original Shared Recurrent Memory Transformer implementation
  ☆33Updated 4 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 7 months ago
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆27Updated 9 months ago
• asappresearch / webagents-step
  ☆41Updated last year
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 7 months ago