Alternatives and similar repositories for agent-evals:

Users that are interested in agent-evals are comparing it to the libraries listed below

• arcee-ai / DAM
  ☆48Updated 5 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 7 months ago
• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆16Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆40Updated 2 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• kyegomez / SelfExtend
  Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
  ☆13Updated 5 months ago
• SalesforceAIResearch / CodeTree
  Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
  ☆17Updated last week
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated last year
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated last year
• dinobby / MAgICoRE
  ☆24Updated 6 months ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆21Updated last week
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆23Updated 2 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 2 months ago
• gangiswag / infogent
  ☆20Updated last month
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 2 months ago
• SalesforceAIResearch / text2data
  ☆19Updated 2 months ago
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆41Updated 3 months ago
• facebookresearch / NeuralMemory
  A Data Source for Reasoning Embodied Agents
  ☆19Updated last year
• cyzus / thoughtsculpt
  ☆13Updated 3 months ago
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆20Updated last week
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• kilian-group / phantom-wiki
  Python package for generating datasets to evaluate reasoning and retrieval of large language models
  ☆17Updated this week
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆21Updated 4 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆45Updated 6 months ago
• mmhamdy / open-language-models
  A list of language models with permissive licenses such as MIT or Apache 2.0
  ☆24Updated last month
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated 7 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last month
• xjdr-alt / muzero_sketch
  ☆38Updated 8 months ago