princeton-nlp / ProLong
Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
☆174Updated last month
Alternatives and similar repositories for ProLong:
Users that are interested in ProLong are comparing it to the libraries listed below
- ☆147Updated 3 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆131Updated 6 months ago
- Repo of paper "Free Process Rewards without Process Labels"☆140Updated 3 weeks ago
- The HELMET Benchmark☆127Updated this week
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆181Updated 8 months ago
- A Comprehensive Survey on Long Context Language Modeling☆126Updated 2 weeks ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆175Updated 3 weeks ago
- Code for Paper: Teaching Language Models to Critique via Reinforcement Learning☆88Updated last month
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆114Updated last month
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆153Updated 9 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆105Updated last month
- ☆55Updated last month
- [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"☆72Updated 4 months ago
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation☆23Updated last week
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆163Updated 9 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆181Updated 6 months ago
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆99Updated 2 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆73Updated 10 months ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆101Updated 4 months ago
- ☆182Updated last month
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆74Updated 2 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated last year
- Long Context Extension and Generalization in LLMs☆53Updated 6 months ago
- The official repository of the Omni-MATH benchmark.☆79Updated 3 months ago
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".☆89Updated last month
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆133Updated 2 months ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆58Updated 3 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆61Updated 5 months ago
- ☆146Updated 2 weeks ago
- ☆86Updated last week