A training-free framework that accelerates diffusion language models through dynamic cache eviction and sparse attention
☆30Oct 16, 2025Updated 11 months ago
Alternatives and similar repositories for Sparse-dLLM
Users that are interested in Sparse-dLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Methods and code for extending the context length of diffusion language models☆56Dec 7, 2025Updated 10 months ago
- We introduce UltraLLaDA , a scaled variant of LLaDA-8B-Base that extends the context length up to 128K tokens with light-weight post-trai…☆15Oct 23, 2025Updated 11 months ago
- [ICLR 2026] Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decoding☆37Jan 27, 2026Updated 8 months ago
- An imaginary extension of rotary position embeddings for long-context language models☆34Dec 9, 2025Updated 10 months ago
- [ICML 2026] Official implementation of "FOCUS: DLLMs Know How to Tame Their Compute Bound".☆19Aug 2, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Princ…☆46Jul 18, 2025Updated last year
- A post-training framework for diffusion language models with supervised fine-tuning and reinforcement learning☆164Mar 30, 2026Updated 6 months ago
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆215May 1, 2026Updated 5 months ago
- The official github repo for "Training Optimal Large Diffusion Language Models", the first-ever large-scale diffusion language models sca…☆46Nov 6, 2025Updated 11 months ago
- [ICLR 2026] SparseD: Sparse Attention for Diffusion Language Models☆68Feb 22, 2026Updated 7 months ago
- The official implementation of MaskGRPO: Consolidating Reinforcement Learning for Multimodal Discrete Diffusion Models. (ICLR 2026, arxiv…☆19Jan 27, 2026Updated 8 months ago
- ICLR 2026☆48May 29, 2026Updated 4 months ago
- [NeurIPS'25] dKV-Cache: The Cache for Diffusion Language Models☆136May 22, 2025Updated last year
- [NeurIPS 2025 Spotlight] Implementation of "KLASS: KL-Guided Fast Inference in Masked Diffusion Models"☆35Jan 3, 2026Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICML 2026] Prism: Spectral-Aware Block-Sparse Attention☆27May 22, 2026Updated 4 months ago
- Official implementation of "DPad: Efficient Diffusion Language Models with Suffix Dropout"☆66Feb 13, 2026Updated 7 months ago
- Offical implementation of our paper "Exploring the Potential of Diffusion Large Language Models in Code Generation".☆23Sep 26, 2026Updated last week
- ☆114Nov 17, 2025Updated 10 months ago
- [ICLR 2026] ParallelBench: Understanding the Tradeoffs of Parallel Decoding in Diffusion LLMs☆48Mar 27, 2026Updated 6 months ago
- ☆31Aug 18, 2025Updated last year
- Advancing Block Diffusion Language Models for Test-Time Scaling☆16Feb 14, 2026Updated 7 months ago
- [ICLR 2026] Official PyTorch implementation for "ReFusion: A Diffusion Large Language Model with Parallel Autoregressive Decoding"☆64Dec 26, 2025Updated 9 months ago
- A Collection of Papers on Diffusion Language Models☆188Aug 2, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆1,095May 30, 2026Updated 4 months ago
- Use the tokenizer in parallel to achieve superior acceleration☆20Mar 21, 2024Updated 2 years ago
- Offical Repository for Paper: DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generation☆19Dec 7, 2025Updated 10 months ago
- Official implementation of ICML2025 paper "ToMA: Token Merge with Attention for Diffusion Models"☆21Aug 6, 2025Updated last year
- [NeurIPS 2026] Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models☆24Sep 29, 2026Updated last week
- GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…☆343Nov 11, 2025Updated 10 months ago
- Code for MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization☆29Updated this week
- LLaDA2.0 is the diffusion language model series developed by InclusionAI team, Ant Group.☆527Jul 22, 2026Updated 2 months ago
- [NeurIPS 2024] Can Language Models Learn to Skip Steps?☆22Jan 25, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The official implementation of dLLM-Var☆35Nov 6, 2025Updated 11 months ago
- A benchmark for evaluating future-event forecasting from audio and video context in multimodal language models☆29Jan 22, 2026Updated 8 months ago
- [ICLR'26] Official PyTorch implementation of "Time Is a Feature: Exploiting Temporal Dynamics in Diffusion Language Models".☆66Mar 5, 2026Updated 7 months ago
- Open diffusion language model for code generation — releasing pretraining, evaluation, inference, and checkpoints.☆660Jul 20, 2026Updated 2 months ago
- Dream 7B, a large diffusion language model☆1,278Nov 21, 2025Updated 10 months ago
- A survey of long-context language models covering architecture, infrastructure, training, and evaluation☆64Mar 31, 2025Updated last year
- ☆36Mar 27, 2025Updated last year