Alternatives and similar repositories for eval-analysis-public

Users that are interested in eval-analysis-public are comparing it to the libraries listed below

• poking-agents / modular-public
  ☆22Updated 3 weeks ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆71Updated this week
• LLMSELECTOR / LLMSELECTOR
  ☆69Updated 4 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆95Updated last month
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆42Updated 10 months ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆38Updated 3 weeks ago
• princeton-pli / hal-harness
  ☆92Updated 3 weeks ago
• conglu1997 / ACD
  Automated Capability Discovery via Foundation Model Self-Exploration
  ☆52Updated 4 months ago
• ScalingIntelligence / codemonkeys
  ☆41Updated 5 months ago
• MurtyShikhar / NNetnav
  Interaction-first method for generating demonstrations for web-agents on any website
  ☆41Updated last month
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆31Updated 2 months ago
• allenai / infinigram-api
  ☆61Updated 3 weeks ago
• google-deepmind / mishax
  ☆134Updated 2 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆76Updated this week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆94Updated 3 months ago
• centerforaisafety / emergent-values
  Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"
  ☆51Updated 4 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆78Updated 4 months ago
• anthropic-experimental / agentic-misalignment
  ☆211Updated last week
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 5 months ago
• sujitpal / llm-rag-eval
  Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.
  ☆28Updated last year
• brendanhogan / picoDeepResearch
  ☆63Updated last month
• SakanaAI / RLT
  Training teachers with reinforcement learning able to make LLMs learn how to reason for test time scaling.
  ☆122Updated this week
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆23Updated 2 months ago
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆41Updated last month
• yueqis / API-Based-Agent
  ☆50Updated 3 weeks ago
• PrimeIntellect-ai / genesys
  ☆127Updated 3 months ago
• LachlanGray / lmql-tree-of-thoughts
  LMQL implementation of tree of thoughts
  ☆34Updated last year
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆82Updated 3 weeks ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 4 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆70Updated 6 months ago