Alternatives and similar repositories for modular-public

Users that are interested in modular-public are comparing it to the libraries listed below

• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆99Updated 2 weeks ago
• METR / RE-Bench
  ☆92Updated 2 months ago
• google-deepmind / dangerous-capability-evaluations
  ☆55Updated 9 months ago
• METR / task-standard
  METR Task Standard
  ☆151Updated 5 months ago
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆28Updated last year
• google-deepmind / mishax
  ☆134Updated 3 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆78Updated 3 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆33Updated 5 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 11 months ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆42Updated 9 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆89Updated this week
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆207Updated this week
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆250Updated last week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 4 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆154Updated 2 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 months ago
• joshuacnf / Ctrl-G
  ☆86Updated 6 months ago
• rgreenblatt / arc_draw_more_samples_pub
  Draw more samples
  ☆192Updated last year
• LeonGuertler / UnstableBaselines
  ☆90Updated this week
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆23Updated 3 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 5 months ago
• METR / public-tasks
  ☆99Updated 4 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 11 months ago
• ahstat / episodic-memory-benchmark
  Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…
  ☆46Updated 3 months ago
• willccbb / localchat
  ☆14Updated 3 months ago
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆91Updated last month
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆48Updated last week
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆35Updated last year
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆220Updated 4 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆149Updated 5 months ago