A training-free framework that accelerates diffusion language models through dynamic cache eviction and sparse attention
☆29Oct 16, 2025Updated 11 months ago
Alternatives and similar repositories for Sparse-dLLM
Users that are interested in Sparse-dLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Methods and code for extending the context length of diffusion language models☆56Dec 7, 2025Updated 9 months ago
- We introduce UltraLLaDA , a scaled variant of LLaDA-8B-Base that extends the context length up to 128K tokens with light-weight post-trai…☆15Oct 23, 2025Updated 10 months ago
- [ICLR 2026] Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decoding☆35Jan 27, 2026Updated 7 months ago
- [ICLR 2026] AdaBlock-dLLM: Semantic-Aware Diffusion LLM Inference via Adaptive Block Size☆16Jan 28, 2026Updated 7 months ago
- Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Princ…☆46Jul 18, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A post-training framework for diffusion language models with supervised fine-tuning and reinforcement learning☆165Mar 30, 2026Updated 5 months ago
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆214May 1, 2026Updated 4 months ago
- The official github repo for "Training Optimal Large Diffusion Language Models", the first-ever large-scale diffusion language models sca…☆46Nov 6, 2025Updated 10 months ago
- The official implementation of MaskGRPO: Consolidating Reinforcement Learning for Multimodal Discrete Diffusion Models. (ICLR 2026, arxiv…☆19Jan 27, 2026Updated 7 months ago
- [ICLR'26] Official code of paper "d2Cache: Accelerating Diffusion-based LLMs via Dual Adaptive Caching"☆188May 14, 2026Updated 4 months ago
- ☆55Apr 14, 2026Updated 5 months ago
- [NeurIPS'25] dKV-Cache: The Cache for Diffusion Language Models☆136May 22, 2025Updated last year
- [NeurIPS 2025 Spotlight] Implementation of "KLASS: KL-Guided Fast Inference in Masked Diffusion Models"☆34Jan 3, 2026Updated 8 months ago
- [ICML 2026] Prism: Spectral-Aware Block-Sparse Attention☆27May 22, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Official implementation of "DPad: Efficient Diffusion Language Models with Suffix Dropout"☆66Feb 13, 2026Updated 7 months ago
- Offical implementation of our paper "Exploring the Potential of Diffusion Large Language Models in Code Generation".☆23Oct 29, 2025Updated 10 months ago
- ☆112Nov 17, 2025Updated 10 months ago
- [ICLR 2026] ParallelBench: Understanding the Tradeoffs of Parallel Decoding in Diffusion LLMs☆47Mar 27, 2026Updated 5 months ago
- ☆31Aug 18, 2025Updated last year
- Advancing Block Diffusion Language Models for Test-Time Scaling☆16Feb 14, 2026Updated 7 months ago
- [ICLR 2026] Official PyTorch implementation for "ReFusion: A Diffusion Large Language Model with Parallel Autoregressive Decoding"☆64Dec 26, 2025Updated 8 months ago
- A Collection of Papers on Diffusion Language Models☆186Aug 2, 2026Updated last month
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆1,088May 30, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Use the tokenizer in parallel to achieve superior acceleration☆20Mar 21, 2024Updated 2 years ago
- Offical Repository for Paper: DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generation☆19Dec 7, 2025Updated 9 months ago
- Official implementation of ICML2025 paper "ToMA: Token Merge with Attention for Diffusion Models"☆21Aug 6, 2025Updated last year
- Code for MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization☆23Feb 18, 2026Updated 7 months ago
- Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models☆24May 19, 2026Updated 4 months ago
- GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…☆344Nov 11, 2025Updated 10 months ago
- LLaDA2.0 is the diffusion language model series developed by InclusionAI team, Ant Group.☆527Jul 22, 2026Updated last month
- LightningRL: Breaking the Accuracy–Parallelism Trade-off of Block-wise dLLMs via Reinforcement Learning☆33Apr 25, 2026Updated 4 months ago
- A benchmark for evaluating future-event forecasting from audio and video context in multimodal language models☆29Jan 22, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICLR'26] Official PyTorch implementation of "Time Is a Feature: Exploiting Temporal Dynamics in Diffusion Language Models".☆66Mar 5, 2026Updated 6 months ago
- Open diffusion language model for code generation — releasing pretraining, evaluation, inference, and checkpoints.☆656Jul 20, 2026Updated last month
- Dream 7B, a large diffusion language model☆1,269Nov 21, 2025Updated 9 months ago
- ☆146Aug 31, 2026Updated 2 weeks ago
- A survey of long-context language models covering architecture, infrastructure, training, and evaluation☆64Mar 31, 2025Updated last year
- [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization☆40Sep 24, 2024Updated last year
- Official implementation of CoNSAL for analytical Lyapunov function discovery☆12Jun 26, 2024Updated 2 years ago