Alternatives and similar repositories for eval-analysis-public

Users that are interested in eval-analysis-public are comparing it to the libraries listed below

• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆73Updated this week
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆42Updated 10 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆85Updated 9 months ago
• yale-nlp / SciArena
  Analysis code for paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"
  ☆42Updated 2 weeks ago
• centerforaisafety / emergent-values
  Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"
  ☆52Updated 4 months ago
• nikitadhawan / natural
  ☆43Updated 8 months ago
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆52Updated 2 months ago
• conglu1997 / ACD
  Automated Capability Discovery via Foundation Model Self-Exploration
  ☆57Updated 5 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆99Updated 4 months ago
• brendanhogan / picoDeepResearch
  ☆64Updated last month
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆71Updated 7 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 5 months ago
• poking-agents / modular-public
  ☆23Updated last month
• princeton-pli / hal-harness
  ☆97Updated 2 weeks ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆97Updated 2 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆23Updated 3 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆82Updated 4 months ago
• google-deepmind / mishax
  ☆134Updated 3 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆91Updated this week
• huggingface / wikirace-llms
  ☆23Updated 2 months ago
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆91Updated last month
• LLMSELECTOR / LLMSELECTOR
  ☆71Updated 4 months ago
• HazyResearch / eclair-agents
  Automating enterprise workflows with multimodal agents
  ☆108Updated 9 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 11 months ago
• SalesforceAIResearch / perfcodegen
  ☆40Updated 2 months ago
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 months ago
• marketagents-ai / MarketAgents
  A distributed agent orchestration framework for market agents
  ☆102Updated 3 weeks ago
• yueqis / API-Based-Agent
  ☆51Updated 3 weeks ago
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆42Updated 2 months ago
• hamelsmu / replicate-examples
  ☆22Updated last year