Alternatives and similar repositories for core-bench:

Users that are interested in core-bench are comparing it to the libraries listed below

• princeton-pli / hal-harness
  ☆60Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆168Updated last month
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆80Updated last week
• allenai / discoveryworld
  A virtual environment for developing and evaluating automated scientific discovery agents.
  ☆143Updated last month
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆72Updated 8 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆83Updated 4 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆103Updated last year
• METR / RE-Bench
  ☆72Updated 2 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆129Updated last week
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆114Updated this week
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆31Updated last week
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆36Updated 3 months ago
• Zhiyuan-Zeng / EvalTree
  [arXiv] EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
  ☆15Updated last month
• AkariAsai / ScholarQABench
  This repository contains ScholarQABench data and evaluation pipeline.
  ☆71Updated last week
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆191Updated 3 weeks ago
• GAIR-NLP / AIME-Preview
  ☆57Updated last month
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆74Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆196Updated last week
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆74Updated 5 months ago
• SalesforceAIResearch / LaTRO
  ☆114Updated 2 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆209Updated last week
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆63Updated 2 months ago
• allenai / super-benchmark
  ☆41Updated 2 weeks ago
• ScalerLab / JudgeBench
  ☆70Updated 5 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 4 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆187Updated 4 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆39Updated last month
• xiaowu0162 / LongMemEval
  Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)
  ☆65Updated 2 months ago