Alternatives and similar repositories for modular-public

Users that are interested in modular-public are comparing it to the libraries listed below

• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆120Updated last week
• METR / RE-Bench
  ☆117Updated last month
• METR / task-standard
  METR Task Standard
  ☆167Updated 9 months ago
• METR / public-tasks
  ☆106Updated last week
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆308Updated last week
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆174Updated this week
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆163Updated 6 months ago
• PrimeIntellect-ai / genesys
  ☆135Updated 7 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 8 months ago
• google-deepmind / mishax
  ☆143Updated 2 months ago
• LeonGuertler / UnstableBaselines
  ☆106Updated 3 weeks ago
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆214Updated last year
• rgreenblatt / arc_draw_more_samples_pub
  Draw more samples
  ☆195Updated last year
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 9 months ago
• MinhxLe / subliminal-learning
  ☆104Updated 3 months ago
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆317Updated this week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆108Updated 8 months ago
• jerber / lang-jepa
  ☆126Updated 10 months ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆284Updated this week
• google-deepmind / dangerous-capability-evaluations
  ☆62Updated last month
• princeton-pli / hal-harness
  ☆186Updated this week
• ScalingIntelligence / codemonkeys
  ☆59Updated 9 months ago
• conglu1997 / ACD
  Automated Capability Discovery via Foundation Model Self-Exploration
  ☆65Updated 9 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆304Updated 2 weeks ago
• UKGovernmentBEIS / control-arena
  ControlArena is a collection of settings, model organisms and protocols - for running control experiments.
  ☆127Updated last week
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆129Updated 7 months ago
• pyember / ember
  ☆232Updated 4 months ago
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆98Updated 5 months ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆450Updated last year