Alternatives and similar repositories for agent-evals

Users that are interested in agent-evals are comparing it to the libraries listed below

• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated 11 months ago
• arcee-ai / DAM
  ☆54Updated 9 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆22Updated last week
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆48Updated 10 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆57Updated 4 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 4 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆49Updated 9 months ago
• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆18Updated last year
• du-nlp-lab / MLR-Copilot
  ☆66Updated 4 months ago
• Aloriosa / srmt
  The original Shared Recurrent Memory Transformer implementation
  ☆30Updated last month
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 4 months ago
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆32Updated 3 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆104Updated 3 months ago
• dinobby / MAgICoRE
  ☆24Updated 11 months ago
• google-deepmind / llms_can_learn_rules
  ☆59Updated 8 months ago
• austrian-code-wizard / c3po
  ☆29Updated 2 weeks ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆70Updated 4 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 6 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆37Updated 6 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆87Updated last week
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆54Updated last month
• metal-chart-generation / metal
  ☆37Updated 2 months ago
• csinva / tree-prompt
  Tree prompting: easy-to-use scikit-learn interface for improved prompting.
  ☆40Updated last year
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆36Updated last year
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 9 months ago
• yueqis / API-Based-Agent
  ☆54Updated last month
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 6 months ago
• uiuc-kang-lab / agentic-benchmarks
  ☆38Updated 3 weeks ago