The code for the paper: "Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models"
☆57Oct 24, 2025Updated 10 months ago
Alternatives and similar repositories for Same-Task-More-Tokens
Users that are interested in Same-Task-More-Tokens are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Jun 6, 2022Updated 4 years ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆113Feb 20, 2025Updated last year
- LongAttn :Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆393Jan 4, 2024Updated 2 years ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆241Aug 2, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Apr 17, 2024Updated 2 years ago
- [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"☆83Nov 25, 2024Updated last year
- [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆32Apr 8, 2024Updated 2 years ago
- self-adaptive in-context learning☆43May 5, 2023Updated 3 years ago
- Implementation of a holodeck, written in Pytorch☆19Nov 1, 2023Updated 2 years ago
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆19Mar 15, 2024Updated 2 years ago
- ACL Workshop 2023☆16Jan 3, 2024Updated 2 years ago
- To assess the longtext capabilities more comprehensively, we propose Needle-in-a-Haystack PLUS, which shifts the focus from simple fact r…☆13Mar 4, 2024Updated 2 years ago
- Corpus exploration platform using advanced tools such as interactive summarization and multi document coreference resolution☆12Jun 15, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆65Jun 12, 2025Updated last year
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation☆36Feb 26, 2026Updated 6 months ago
- ☆10Jul 18, 2022Updated 4 years ago
- ☆15Aug 3, 2021Updated 5 years ago
- A repository of OpenDecoder framework: Open Large Language Model Decoding to Incorporate Document Quality in RAG (WWW 2026)☆27Jan 27, 2026Updated 7 months ago
- Efficient retrieval head analysis with triton flash attention that supports topK probability☆13Jun 15, 2024Updated 2 years ago
- ☆30Jul 2, 2023Updated 3 years ago
- ☆19Mar 25, 2025Updated last year
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆28Mar 24, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆41Oct 11, 2024Updated last year
- Dataset and baseline for Coling 2022 long paper (oral): "ConFiguRe: Exploring Discourse-level Chinese Figures of Speech"☆12Jul 27, 2023Updated 3 years ago
- ☆14Dec 19, 2024Updated last year
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆264Dec 16, 2024Updated last year
- Training project about Deep Learing☆12Jun 22, 2017Updated 9 years ago
- A framework for building (and incrementally growing) graph-based data structures used in hierarchical or DAG-structured clustering and ne…☆45Feb 23, 2023Updated 3 years ago
- ☆17Jun 14, 2023Updated 3 years ago
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆48Jun 12, 2023Updated 3 years ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆118Oct 11, 2025Updated 11 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Syntax Error-Free and Generalizable Tool Use for LLMs via Finite-State Decoding☆31Jan 28, 2024Updated 2 years ago
- ☆13Aug 25, 2021Updated 5 years ago
- Rationale-enhanced language models are better continual relation learners (EMNLP 2023 Main Conference)☆12Oct 11, 2023Updated 2 years ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆266Sep 12, 2025Updated last year
- public repo for ESTER dataset and modeling (EMNLP'21)☆20Feb 2, 2022Updated 4 years ago
- A Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation, Levy et al., Findings of EMNLP 2021☆14Apr 3, 2022Updated 4 years ago
- Self-Supervised Alignment with Mutual Information☆20May 24, 2024Updated 2 years ago