Alternatives and similar repositories for llm_forecasting

Users that are interested in llm_forecasting are comparing it to the libraries listed below

• ApolloResearch / insider-trading
  ☆56Updated last year
• vinid / NegotiationArena
  ☆80Updated last year
• sambowyer / bayes_evals
  A lightweight library for Bayesian analysis of LLM evals (ICML 2025 Spotlight Position Paper)
  ☆21Updated 7 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆183Updated last week
• rmovva / HypotheSAEs
  HypotheSAEs: hypothesizing interpretable relationships in text datasets using sparse autoencoders. https://arxiv.org/abs/2502.04382
  ☆71Updated 2 months ago
• princeton-pli / hal-harness
  ☆214Updated 3 weeks ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆97Updated 3 months ago
• causalNLP / cladder
  We develop benchmarks and analysis tools to evaluate the causal reasoning abilities of LLMs.
  ☆136Updated last year
• forecastingresearch / forecastbench-datasets
  Forecastbench Datasets, updated nightly
  ☆22Updated this week
• MinhxLe / subliminal-learning
  ☆105Updated 5 months ago
• METR / RE-Bench
  ☆130Updated 3 months ago
• marcelbinz / Llama-3.1-Centaur-70B
  ☆194Updated 6 months ago
• nikitadhawan / natural
  ☆43Updated last year
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆124Updated last year
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆46Updated last year
• siegelz / core-bench
  ☆62Updated last month
• HannahKirk / prism-alignment
  The Prism Alignment Project
  ☆87Updated last year
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆325Updated 2 months ago
• ChicagoHAI / hypothesis-generation
  This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…
  ☆101Updated 2 months ago
• javyduck / KnowHalu
  ☆50Updated last year
• sandeep82945 / Future-Idea-Generation
  ☆14Updated 11 months ago
• rrtucci / mappa_mundi
  Causal DAG Extraction from Text (DEFT)
  ☆66Updated last year
• giorgiopiatti / GovSim
  Governance of the Commons Simulation (GovSim)
  ☆64Updated last year
• robertvacareanu / llm4regression
  Examining how large language models (LLMs) perform across various synthetic regression tasks when given (input, output) examples in their…
  ☆160Updated 3 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• bhaweshiitk / ConformalLLM
  Extending Conformal Prediction to LLMs
  ☆69Updated last year
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆52Updated 11 months ago
• allenai / hybrid-preferences
  Learning to route instances for Human vs AI Feedback (ACL Main '25)
  ☆26Updated 5 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆167Updated 9 months ago
• google-deepmind / dangerous-capability-evaluations
  ☆64Updated last week