Alternatives and similar repositories for forecastbench

Users that are interested in forecastbench are comparing it to the libraries listed below

• forecastingresearch / forecastbench-datasets
  Forecastbench Datasets, updated nightly
  ☆22Updated this week
• giorgiopiatti / GovSim
  Governance of the Commons Simulation (GovSim)
  ☆64Updated last year
• emergent-misalignment / emergent-misalignment
  ☆252Updated last week
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆167Updated 9 months ago
• AgentTorch / AgentTorch
  large population models
  ☆563Updated this week
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆97Updated 3 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆124Updated last year
• rosewang2008 / bridge
  NAACL 2024. Code & Dataset for "🌁 Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistake…
  ☆45Updated last year
• vinid / NegotiationArena
  ☆80Updated last year
• ApolloResearch / insider-trading
  ☆56Updated last year
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆325Updated 2 months ago
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆82Updated last year
• marketagents-ai / MarketAgents
  An agent orchestration framework for economic agents
  ☆112Updated 5 months ago
• ServiceNow / context-is-key-forecasting
  Context is Key: A Benchmark for Forecasting with Essential Textual Information
  ☆84Updated 5 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆112Updated 11 months ago
• centerforaisafety / emergent-values
  Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"
  ☆86Updated 10 months ago
• dannyallover / llm_forecasting
  Forecasting with LLMs
  ☆55Updated last year
• bethgelab / CiteME
  CiteME is a benchmark designed to test the abilities of language models in finding papers that are cited in scientific texts.
  ☆48Updated 2 months ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆131Updated 2 weeks ago
• nikitadhawan / natural
  ☆43Updated last year
• safety-research / persona_vectors
  Persona Vectors: Monitoring and Controlling Character Traits in Language Models
  ☆330Updated 5 months ago
• aounon / llm-rank-optimizer
  ☆118Updated 5 months ago
• causalNLP / cladder
  We develop benchmarks and analysis tools to evaluate the causal reasoning abilities of LLMs.
  ☆136Updated last year
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆226Updated last month
• marcelbinz / Llama-3.1-Centaur-70B
  ☆194Updated 6 months ago
• EleutherAI / elk
  Keeping language models honest by directly eliciting knowledge encoded in their activations.
  ☆216Updated last week
• princeton-pli / hal-harness
  ☆214Updated 3 weeks ago
• METR / public-tasks
  ☆116Updated 2 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆137Updated 11 months ago
• haizelabs / bijection-learning
  ☆26Updated last year