Alternatives and similar repositories for discoverybench

Users that are interested in discoverybench are comparing it to the libraries listed below

• allenai / discoveryworld
  A virtual environment for developing and evaluating automated scientific discovery agents.
  ☆180Updated 5 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 5 months ago
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆98Updated this week
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆94Updated 8 months ago
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆42Updated 10 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆213Updated 3 weeks ago
• ChicagoHAI / hypothesis-generation
  This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…
  ☆84Updated last week
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆150Updated 6 months ago
• snap-stanford / MLAgentBench
  ☆301Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆105Updated 6 months ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆85Updated last year
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆132Updated last week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆179Updated 5 months ago
• METR / RE-Bench
  ☆98Updated 4 months ago
• AkariAsai / ScholarQABench
  This repository contains ScholarQABench data and evaluation pipeline.
  ☆78Updated 2 weeks ago
• google-deepmind / mishax
  ☆141Updated last week
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆51Updated 5 months ago
• SALT-NLP / demonstrated-feedback
  ☆127Updated 10 months ago
• allenai / infinigram-api
  ☆78Updated last week
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 4 months ago
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆47Updated last year
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆129Updated 2 years ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 5 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 10 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆89Updated last year
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆46Updated 9 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• vinid / NegotiationArena
  ☆73Updated last year
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆158Updated 4 months ago
• HannahKirk / prism-alignment
  The Prism Alignment Project
  ☆79Updated last year