Alternatives and similar repositories for eval-analysis-public

Users that are interested in eval-analysis-public are comparing it to the libraries listed below

• OpenForecaster / scaling-forecasting-training
  Codebase from our first release.
  ☆43Updated last month
• MinhxLe / subliminal-learning
  ☆107Updated last week
• conglu1997 / ACD
  Automated Capability Discovery via Foundation Model Self-Exploration
  ☆66Updated 11 months ago
• centerforaisafety / emergent-values
  Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"
  ☆88Updated 11 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆112Updated 9 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆119Updated 9 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated last year
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆261Updated this week
• anthropic-experimental / automated-auditing
  Prompts used in the Automated Auditing Blog Post
  ☆137Updated 6 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆239Updated last year
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆65Updated 9 months ago
• sunnweiwei / PPP-Agent
  Training Proactive and Personalized LLM Agents
  ☆98Updated 3 weeks ago
• PrimeIntellect-ai / prime
  Official CLI and Python SDK for Prime Intellect - access GPU compute, remote sandboxes, RL environments, and distributed training infrast…
  ☆151Updated this week
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆185Updated 8 months ago
• SakanaAI / drq
  Digital Red Queen: Adversarial Program Evolution in Core War with LLMs
  ☆176Updated 3 weeks ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆90Updated last month
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆259Updated last month
• SakanaAI / ab-mcts-arc2
  ☆106Updated 7 months ago
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 9 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 11 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆92Updated last year
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆336Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 11 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 10 months ago
• ScalingIntelligence / codemonkeys
  ☆59Updated last year
• jerber / arc_agi
  ☆67Updated 6 months ago
• allenai / infinigram-api
  ☆93Updated last month
• metauto-ai / HGM
  🧬 The Huxley-Gödel Machine
  ☆324Updated this week
• guestrin-lab / deepscholar
  build and benchmark deep research
  ☆229Updated last week
• stanford-oval / genie-worksheets
  Specification for creating reliable LLM-based conversational agents
  ☆65Updated 3 months ago