Alternatives and similar repositories for modular-public

Users that are interested in modular-public are comparing it to the libraries listed below

• METR / task-standard
  METR Task Standard
  ☆162Updated 8 months ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆111Updated this week
• METR / RE-Bench
  ☆102Updated 5 months ago
• METR / public-tasks
  ☆104Updated last week
• rgreenblatt / arc_draw_more_samples_pub
  Draw more samples
  ☆194Updated last year
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆160Updated 5 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆300Updated last week
• google-deepmind / mishax
  ☆142Updated 3 weeks ago
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆116Updated this week
• LeonGuertler / UnstableBaselines
  ☆103Updated 2 weeks ago
• MinhxLe / subliminal-learning
  ☆97Updated 2 months ago
• google-deepmind / dangerous-capability-evaluations
  ☆58Updated last week
• jerber / lang-jepa
  ☆124Updated 9 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆283Updated this week
• safety-research / safety-tooling
  Inference API for many LLMs and other useful tools for empirical research
  ☆74Updated last week
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆241Updated this week
• callummcdougall / sae_visualizer
  ☆29Updated last year
• neoneye / ARC-Interactive-History-Dataset
  The history files when recording human interaction while solving ARC tasks
  ☆116Updated last week
• amack315 / unsupervised-steering-vectors
  ☆34Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆28Updated last year
• PrimeIntellect-ai / genesys
  ☆135Updated 6 months ago
• UKGovernmentBEIS / control-arena
  ControlArena is a collection of settings, model organisms and protocols - for running control experiments.
  ☆99Updated this week
• xjdr-alt / entropix-local
  smol models are fun too
  ☆93Updated 10 months ago
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 8 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆184Updated 7 months ago
• Cadenza-Labs / sleeper-agents
  ☆12Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆181Updated 2 months ago
• CyrusNuevoDia / llegos
  A strongly typed Python DSL for developing message passing multi agent systems
  ☆53Updated last year
• princeton-pli / hal-harness
  ☆136Updated this week