OpenMOSS / LongLLaDALinks
LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs
☆32Updated last month
Alternatives and similar repositories for LongLLaDA
Users that are interested in LongLLaDA are comparing it to the libraries listed below
Sorting:
- Esoteric Language Models☆94Updated last month
- A Sober Look at Language Model Reasoning☆81Updated 2 months ago
- ☆18Updated 3 weeks ago
- The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free☆47Updated 3 months ago
- Unofficial Implementation of Selective Attention Transformer☆17Updated 9 months ago
- Remasking Discrete Diffusion Models with Inference-Time Scaling☆38Updated 5 months ago
- Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)☆56Updated 9 months ago
- ☆106Updated 2 years ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆86Updated 11 months ago
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆73Updated 6 months ago
- Process Reward Models That Think☆48Updated last month
- Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""☆16Updated 2 months ago
- Stick-breaking attention☆59Updated last month
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆44Updated 4 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆44Updated last month
- Trust Region Preference Approximation: A simple and stable reinforcement learning algorithm for LLM reasoning☆12Updated 2 months ago
- official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…☆66Updated 4 months ago
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆30Updated 9 months ago
- Reinforcing General Reasoning without Verifiers☆80Updated 2 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆118Updated last month
- ☆50Updated 2 months ago
- Official repository for paper "DeepCritic: Deliberate Critique with Large Language Models"☆34Updated 2 months ago
- ☆87Updated last month
- ☆85Updated last year
- Long Context Extension and Generalization in LLMs☆58Updated 11 months ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆83Updated last year
- ☆34Updated 7 months ago
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆58Updated last year
- Code for "Reasoning to Learn from Latent Thoughts"☆116Updated 5 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆81Updated 10 months ago