Alternatives and similar repositories for llm_forecasting

Users that are interested in llm_forecasting are comparing it to the libraries listed below

• socialfoundations / folktexts
  Evaluate uncertainty, calibration, accuracy, and fairness of LLMs on real-world survey data!
  ☆23Updated 3 months ago
• ExtensityAI / benchmark
  Evaluation of neuro-symbolic engines
  ☆38Updated 11 months ago
• Weixin-Liang / Mapping-the-Increasing-Use-of-LLMs-in-Scientific-Papers
  ☆48Updated last month
• sambowyer / bayes_evals
  A lightweight library for Bayesian analysis of LLM evals (ICML 2025 Spotlight Position Paper)
  ☆18Updated last month
• marcelbinz / Llama-3.1-Centaur-70B
  ☆116Updated 2 weeks ago
• ApolloResearch / insider-trading
  ☆52Updated last year
• nikitadhawan / natural
  ☆43Updated 8 months ago
• rrtucci / mappa_mundi
  Causal DAG Extraction from Text (DEFT)
  ☆66Updated 6 months ago
• ServiceNow / insight-bench
  ☆46Updated last month
• vinid / NegotiationArena
  ☆72Updated last year
• princeton-pli / hal-harness
  ☆97Updated 2 weeks ago
• qrdlgit / graph-of-thoughts
  Based on the tree of thoughts paper
  ☆48Updated last year
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆47Updated last year
• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆13Updated last year
• METR / RE-Bench
  ☆92Updated 2 months ago
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆106Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 9 months ago
• brantondemoss / GrokkingComplexity
  Code for
  ☆27Updated 7 months ago
• ninodimontalcino / moralchoice
  Evaluating the Moral Beliefs Encoded in LLMs
  ☆26Updated 7 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆109Updated last year
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆99Updated last month
• Networks-Learning / counterfactual-llms
  Code for "Counterfactual Token Generation in Large Language Models", Arxiv 2024.
  ☆28Updated 8 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆58Updated 7 months ago
• causalNLP / cladder
  We develop benchmarks and analysis tools to evaluate the causal reasoning abilities of LLMs.
  ☆118Updated last year
• marcelbinz / CENTaUR
  ☆32Updated last year
• javyduck / KnowHalu
  ☆48Updated last year
• genlm / llamppl
  Probabilistic programming with large language models
  ☆124Updated last month
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆44Updated 8 months ago
• allenai / hybrid-preferences
  Learning to route instances for Human vs AI Feedback (ACL 2025 Main)
  ☆23Updated 2 months ago
• rmovva / HypotheSAEs
  Hypothesizing interpretable relationships in text datasets using sparse autoencoders.
  ☆33Updated last week