Alternatives and similar repositories for experiments

Users that are interested in experiments are comparing it to the libraries listed below

• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆23Updated last year
• epoch-research / training-cost-trends
  ☆20Updated 2 weeks ago
• uq-project / UQ
  UQ: Assessing Language Models on Unsolved Questions
  ☆29Updated 4 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated last year
• benediktstroebl / agent-evals
  ☆25Updated 7 months ago
• sunnweiwei / PPP-Agent
  ☆93Updated last month
• Cerebras / inference-examples
  Inference examples
  ☆65Updated 3 months ago
• yale-nlp / SciArena
  Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"
  ☆55Updated 4 months ago
• kyegomez / WhiteRock
  The world's first fully automated VC fund.
  ☆26Updated last week
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 11 months ago
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 8 months ago
• a-antoniades / swe-search
  ☆11Updated last year
• microsoft / Evoke
  Everything for the Paper: 'Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing'
  ☆19Updated 2 years ago
• openai / interactive-textbook-demo
  Interactive Textbook Demo
  ☆52Updated 2 months ago
• raphaelmansuy / iteration_of_tought
  Example implementation of Iteration of Tought - Gives a star if you like the project
  ☆41Updated last year
• axolotl-ai-cloud / axolotl-cookbook
  ☆36Updated 4 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 8 months ago
• nec-research / agentquest
  ☆28Updated 8 months ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated last year
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆26Updated 2 weeks ago
• yueqis / API-Based-Agent
  ☆63Updated 6 months ago
• huggingface / wikirace-llms
  ☆25Updated 7 months ago
• microsoft / EvoPrompt
  Automatic Prompt Optimization
  ☆48Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆168Updated 8 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆38Updated last year
• allenai / olmo-cookbook
  OLMost every training recipe you need to perform data interventions with the OLMo family of models.
  ☆63Updated this week
• agential-ai / agential
  🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!
  ☆54Updated 5 months ago
• Alignment-Lab-AI / Our-Projects
  A repository of projects and datasets under active development by Alignment Lab AI
  ☆22Updated 2 years ago
• miralab-ai / autoreason
  ☆40Updated last year
• ivanleomk / modal-grpo
  ☆19Updated 9 months ago