Alternatives and similar repositories for lm-evaluation-harness:

Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below

• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆130Updated 3 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆66Updated 9 months ago
• protagolabs / odyssey-math
  ☆80Updated 3 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated 9 months ago
• shunzh / Code-AI-Tree-Search
  ☆111Updated 6 months ago
• mukhal / grace
  [EMNLP 2023, Findings] GRACE: Discriminator-Guided Chain-of-Thought Reasoning
  ☆46Updated 3 months ago
• gregorbachmann / Next-Token-Failures
  ☆78Updated 10 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆70Updated last month
• berlino / seq_icl
  ☆51Updated 7 months ago
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆27Updated 7 months ago
• Zayne-sprague / MuSR
  ☆36Updated 5 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆93Updated last year
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆77Updated 5 months ago
• anadim / the-little-retrieval-test
  ☆34Updated last year
• cmu-l3 / ntptutorial-II
  Neural theorem proving tutorial, version II
  ☆30Updated 8 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆150Updated 10 months ago
• wellecks / naturalprover
  NaturalProver: Grounded Mathematical Proof Generation with Language Models
  ☆36Updated last year
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆42Updated last year
• swj0419 / in-context-pretraining
  ☆47Updated 9 months ago
• roeehendel / icl_task_vectors
  ☆85Updated last year
• zhaoxlpku / SubgoalXL
  ☆21Updated 4 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆71Updated 7 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆111Updated 4 months ago
• princeton-nlp / Collie
  [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks
  ☆52Updated last year
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆51Updated 9 months ago
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆130Updated 3 months ago
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆111Updated 2 months ago
• allenai / Lila
  A unified benchmark for math reasoning
  ☆87Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆89Updated 3 years ago