wellecks / lm-evaluation-harnessLinks
A framework for few-shot evaluation of autoregressive language models.
☆24Updated last year
Alternatives and similar repositories for lm-evaluation-harness
Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below
Sorting:
- ☆83Updated 9 months ago
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"☆31Updated last year
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆65Updated 8 months ago
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆123Updated last year
- [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks☆56Updated 2 years ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆142Updated last year
- The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset☆159Updated last year
- NaturalProver: Grounded Mathematical Proof Generation with Language Models☆38Updated 2 years ago
- ☆103Updated last year
- [EMNLP '23] Discriminator-Guided Chain-of-Thought Reasoning☆49Updated last year
- A unified benchmark for math reasoning☆88Updated 2 years ago
- [NeurIPS 2023] Learning Transformer Programs☆162Updated last year
- Self-Alignment with Principle-Following Reward Models☆168Updated last month
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆63Updated last year
- ☆120Updated last year
- Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.☆150Updated last month
- Scratchpad/Chain-of-Thought Prompts☆12Updated 3 years ago
- The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)☆36Updated last year
- ☆185Updated last year
- Code for the paper "Decomposing the Enigma: Subgoal-based Demonstration Learning for Formal Theorem Proving"☆19Updated 2 years ago
- [NeurIPS'24 Spotlight] Observational Scaling Laws☆57Updated last year
- Mix of Minimal Optimal Sets (MMOS) of dataset has two advantages for two aspects, higher performance and lower construction costs on math…☆73Updated last year
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆236Updated last month
- ☆83Updated 2 years ago
- ☆103Updated last year
- Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"☆75Updated 5 months ago
- ☆165Updated last year
- ☆55Updated 5 months ago
- ☆14Updated 3 months ago