Alternatives and similar repositories for TheoremQA

Users that are interested in TheoremQA are comparing it to the libraries listed below

• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆81Updated 9 months ago
• allenai / Lila
  A unified benchmark for math reasoning
  ☆88Updated 2 years ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆161Updated 3 weeks ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆142Updated 7 months ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆159Updated last year
• da03 / implicit_chain_of_thought
  ☆131Updated 6 months ago
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆111Updated last year
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆106Updated 3 months ago
• neulab / gemini-benchmark
  ☆149Updated last year
• protagolabs / odyssey-math
  ☆82Updated 4 months ago
• oriyor / reasoning-on-cots
  Implementation of the paper: "Answering Questions by Meta-Reasoning over Multiple Chains of Thought"
  ☆95Updated last year
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆127Updated 10 months ago
• niansong1996 / lever
  Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)
  ☆87Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆223Updated 7 months ago
• keirp / OpenWebMath
  ☆153Updated last year
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆147Updated 7 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆124Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆226Updated last year
• tianjunz / HIR
  ☆159Updated 2 years ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 8 months ago
• TIGER-AI-Lab / TheoremQA
  The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)
  ☆32Updated last year
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆121Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆174Updated 11 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆155Updated last year
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆101Updated 2 months ago
• Zayne-sprague / MuSR
  ☆44Updated 9 months ago
• XiangLi1999 / ContrastiveDecoding
  contrastive decoding
  ☆200Updated 2 years ago
• zjunlp / FactCHD
  [IJCAI 2024] FactCHD: Benchmarking Fact-Conflicting Hallucination Detection
  ☆87Updated last year
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆68Updated last year