Alternatives and similar repositories for agent-evals

Users that are interested in agent-evals are comparing it to the libraries listed below

• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• arcee-ai / DAM
  ☆49Updated 6 months ago
• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆16Updated last year
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated last month
• SalesforceAIResearch / text2data
  ☆21Updated 3 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆24Updated last month
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 3 months ago
• brendanhogan / completion_tree_view
  ☆9Updated last month
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• kyegomez / SelfExtend
  Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
  ☆12Updated 6 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆25Updated 4 months ago
• axeld5 / pali_reason
  Testing paligemma2 finetuning on reasoning dataset
  ☆18Updated 5 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆34Updated 7 months ago
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆20Updated last week
• yueqis / API-Based-Agent
  ☆50Updated 6 months ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 3 months ago
• huggingface / wikirace-llms
  ☆20Updated 3 weeks ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆58Updated last month
• Tebmer / Rereading-LLM-Reasoning
  EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…
  ☆26Updated 5 months ago
• iulia-b10 / multilingual-embedding-models
  ☆20Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆29Updated 6 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 10 months ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆42Updated this week
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆40Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆55Updated last month
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆33Updated 7 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 7 months ago
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated last year