Alternatives and similar repositories for forecastbench

Users that are interested in forecastbench are comparing it to the libraries listed below

• giorgiopiatti / GovSim
  Governance of the Commons Simulation (GovSim)
  ☆55Updated 5 months ago
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆193Updated 8 months ago
• vinid / NegotiationArena
  ☆72Updated last year
• METR / RE-Bench
  ☆92Updated 2 months ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆99Updated 2 weeks ago
• vals-ai / finance-agent
  ☆14Updated 2 months ago
• emergent-misalignment / emergent-misalignment
  ☆171Updated 4 months ago
• anthropics / sycophancy-to-subterfuge-paper
  ☆23Updated 10 months ago
• forecastingresearch / forecastbench-datasets
  Forecastbench Datasets, updated nightly
  ☆12Updated this week
• causalNLP / cladder
  We develop benchmarks and analysis tools to evaluate the causal reasoning abilities of LLMs.
  ☆118Updated last year
• princeton-pli / hal-harness
  ☆97Updated 2 weeks ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆102Updated 3 weeks ago
• METR / public-tasks
  ☆99Updated 4 months ago
• rosewang2008 / bridge
  NAACL 2024. Code & Dataset for "🌁 Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistake…
  ☆41Updated 11 months ago
• aypan17 / machiavelli
  ☆137Updated 8 months ago
• allenai / safety-eval
  A simple evaluation of generative language models and safety classifiers.
  ☆57Updated 11 months ago
• haizelabs / bijection-learning
  ☆24Updated 8 months ago
• anthropics / evals
  ☆283Updated last year
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆251Updated this week
• dannyallover / llm_forecasting
  Forecasting with LLMs
  ☆49Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆82Updated last year
• bethgelab / CiteME
  CiteME is a benchmark designed to test the abilities of language models in finding papers that are cited in scientific texts.
  ☆48Updated 8 months ago
• allenai / clin
  ☆83Updated last year
• ccs-ucb / llms-cogsci
  Psych 290Q S23 @ UC Berkeley: Large Language Models and Cognitive Science
  ☆18Updated last year
• allenai / hybrid-preferences
  Learning to route instances for Human vs AI Feedback (ACL 2025 Main)
  ☆23Updated 2 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 4 months ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆109Updated last year
• HannahKirk / prism-alignment
  The Prism Alignment Project
  ☆79Updated last year
• ApolloResearch / insider-trading
  ☆52Updated last year