Alternatives and similar repositories for agent-evals:

Users that are interested in agent-evals are comparing it to the libraries listed below

• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆16Updated last year
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 weeks ago
• arcee-ai / DAM
  ☆48Updated 5 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 8 months ago
• iulia-b10 / multilingual-embedding-models
  ☆20Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 3 months ago
• axeld5 / pali_reason
  Testing paligemma2 finetuning on reasoning dataset
  ☆18Updated 4 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆52Updated 3 weeks ago
• SalesforceAIResearch / text2data
  ☆21Updated 2 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆23Updated 3 weeks ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated last month
• JakeFurtaw / Chat-RAG
  Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…
  ☆21Updated last month
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆20Updated last month
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• miralab-ai / autoreason
  ☆41Updated 4 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 3 months ago
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• xjdr-alt / muzero_sketch
  ☆38Updated 9 months ago
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated last year
• yueqis / API-Based-Agent
  ☆50Updated 5 months ago
• glaive-ai / reflection_70b_training
  ☆17Updated 2 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated 7 months ago
• fsndzomga / open_source_lrm
  ☆10Updated 6 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆27Updated 2 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆38Updated 2 weeks ago
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆43Updated 3 months ago
• benpry / why-think-step-by-step
  Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"
  ☆60Updated last month