Alternatives and similar repositories for agent-evals

Users that are interested in agent-evals are comparing it to the libraries listed below

• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆16Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆23Updated 2 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 4 months ago
• gangiswag / infogent
  ☆20Updated 3 months ago
• brendanhogan / completion_tree_view
  ☆10Updated last month
• arcee-ai / DAM
  ☆51Updated 7 months ago
• miralab-ai / autoreason
  ☆41Updated 6 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆31Updated 4 months ago
• huggingface / wikirace-llms
  ☆22Updated last month
• axeld5 / pali_reason
  Testing paligemma2 finetuning on reasoning dataset
  ☆18Updated 5 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 10 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 7 months ago
• catid / lllm
  Latent Large Language Models
  ☆18Updated 9 months ago
• fsndzomga / open_source_lrm
  ☆10Updated 7 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆57Updated 6 months ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆42Updated this week
• kevinwu23 / StanfordFineTuneBench
  ☆30Updated 7 months ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆60Updated 2 months ago
• yueqis / API-Based-Agent
  ☆50Updated 3 weeks ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• SalesforceAIResearch / text2data
  ☆21Updated 4 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 4 months ago
• dinobby / MAgICoRE
  ☆24Updated 9 months ago
• kilian-group / phantom-wiki
  Python package for generating datasets to evaluate reasoning and retrieval of large language models
  ☆18Updated last week
• SidU / MathBlackBox
  ☆11Updated 11 months ago