alonj / Same-Task-More-Tokens
The code for the paper: "Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models"
☆55Updated 9 months ago
Alternatives and similar repositories for Same-Task-More-Tokens:
Users that are interested in Same-Task-More-Tokens are comparing it to the libraries listed below
- [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"☆72Updated 4 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆105Updated last month
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆75Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆73Updated 10 months ago
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆99Updated 2 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆78Updated 4 months ago
- Replicating O1 inference-time scaling laws☆83Updated 4 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆172Updated last month
- Critique-out-Loud Reward Models☆56Updated 5 months ago
- Codebase accompanying the Summary of a Haystack paper.☆77Updated 6 months ago
- Official implementation for "Law of the Weakest Link: Cross capabilities of Large Language Models"☆42Updated 6 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆137Updated 5 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆132Updated 5 months ago
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆29Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆80Updated 8 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆52Updated last year
- ☆55Updated 3 weeks ago
- ☆69Updated last year
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- ☆60Updated 11 months ago
- 🚢 Data Toolkit for Sailor Language Models☆88Updated last month
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆130Updated 6 months ago
- The HELMET Benchmark☆124Updated this week
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- ☆147Updated 3 months ago
- CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings☆30Updated 2 months ago
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆108Updated last month
- Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"☆30Updated 9 months ago
- Code for Paper: Teaching Language Models to Critique via Reinforcement Learning☆88Updated last month
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆55Updated 11 months ago