princeton-nlp / CEPE
[ACL 2024] Long-Context Language Modeling with Parallel Encodings
β153Updated 8 months ago
Alternatives and similar repositories for CEPE:
Users that are interested in CEPE are comparing it to the libraries listed below
- [ICML 2024] Selecting High-Quality Data for Training Language Modelsβ157Updated 8 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuningβ143Updated 5 months ago
- [ICLR 2025] 𧬠RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)β109Updated 2 weeks ago
- β96Updated 5 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Modelsβ76Updated 11 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMsβ241Updated 2 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Modelsβ176Updated 4 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"β160Updated last week
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.β60Updated 4 months ago
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguesβ69Updated 7 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]β100Updated last week
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuningβ242Updated last year
- Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.β129Updated last year
- [SIGIR'24] The official implementation code of MOELoRA.β147Updated 7 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelsβ245Updated 5 months ago
- Code implementation of synthetic continued pretrainingβ91Updated last month
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".β68Updated last month
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]β135Updated 4 months ago
- β96Updated 11 months ago
- Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Processβ25Updated 7 months ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both sameβ¦β41Updated 3 months ago
- Counting-Stars (β )β79Updated 6 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"β72Updated 8 months ago
- β136Updated 2 months ago
- β124Updated 7 months ago
- Repository of LV-Eval Benchmarkβ58Updated 6 months ago
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QAβ111Updated 3 months ago
- Fantastic Data Engineering for Large Language Modelsβ75Updated 2 months ago
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learningβ161Updated last year
- Evaluating the Ripple Effects of Knowledge Editing in Language Modelsβ53Updated 10 months ago