OpenMOSS / LongLLaDALinks
LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs
☆17Updated last week
Alternatives and similar repositories for LongLLaDA
Users that are interested in LongLLaDA are comparing it to the libraries listed below
Sorting:
- We study toy models of skill learning.☆29Updated 5 months ago
- Esoteric Language Models☆81Updated this week
- GoldFinch and other hybrid transformer components☆45Updated 11 months ago
- A repository for research on medium sized language models.☆77Updated last year
- [ACL 2025] Are Your LLMs Capable of Stable Reasoning?☆25Updated 3 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆53Updated 3 months ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated last month
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆33Updated 3 months ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆32Updated 10 months ago
- Remasking Discrete Diffusion Models with Inference-Time Scaling☆30Updated 3 months ago
- ☆80Updated 10 months ago
- Here we will test various linear attention designs.☆59Updated last year
- Official repo of paper LM2☆41Updated 4 months ago
- ☆21Updated 3 weeks ago
- ☆32Updated 5 months ago
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆37Updated 4 months ago
- Unofficial Implementation of Selective Attention Transformer☆17Updated 8 months ago
- ☆20Updated last week
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆47Updated 2 months ago
- Resa: Transparent Reasoning Models via SAEs☆36Updated 2 weeks ago
- Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]☆67Updated 2 months ago
- Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper☆39Updated 3 months ago
- Official Jax Implementation of MD4 Masked Diffusion Models☆108Updated 4 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆33Updated 3 months ago
- Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"☆20Updated last month
- Reinforcing General Reasoning without Verifiers☆63Updated last week
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆29Updated 7 months ago
- Using FlexAttention to compute attention with different masking patterns☆44Updated 9 months ago
- ☆59Updated 3 months ago
- Code accompanying the paper "Generalized Interpolating Discrete Diffusion"☆86Updated 3 weeks ago