Alternatives and similar repositories for agent-evals

Users that are interested in agent-evals are comparing it to the libraries listed below

• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆26Updated last month
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated 10 months ago
• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆16Updated last year
• arcee-ai / DAM
  ☆52Updated 8 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆33Updated 5 months ago
• gangiswag / infogent
  ☆20Updated 4 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆23Updated 3 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆57Updated 3 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆35Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆64Updated 2 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 5 months ago
• lilakk / BLEUBERI
  Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"
  ☆24Updated last month
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆19Updated last month
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆24Updated 4 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆39Updated 8 months ago
• kilian-group / phantom-wiki
  Python package for generating datasets to evaluate reasoning and retrieval of large language models
  ☆18Updated last week
• kevinwu23 / StanfordFineTuneBench
  ☆30Updated 7 months ago
• yueqis / API-Based-Agent
  ☆50Updated 2 weeks ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• austrian-code-wizard / c3po
  ☆27Updated last week
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆48Updated this week
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 5 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 5 months ago
• miralab-ai / autoreason
  ☆40Updated 6 months ago
• SalesforceAIResearch / CodeTree
  Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
  ☆24Updated 3 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆47Updated 9 months ago
• huggingface / wikirace-llms
  ☆23Updated 2 months ago