A training-free framework that accelerates diffusion language models through dynamic cache eviction and sparse attention
☆30Oct 16, 2025Updated last year
Alternatives and similar repositories for Sparse-dLLM
Users that are interested in Sparse-dLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Methods and code for extending the context length of diffusion language models☆56Dec 7, 2025Updated 11 months ago
- We introduce UltraLLaDA , a scaled variant of LLaDA-8B-Base that extends the context length up to 128K tokens with light-weight post-trai…☆15Oct 23, 2025Updated last year
- [ICLR 2026] AdaBlock-dLLM: Semantic-Aware Diffusion LLM Inference via Adaptive Block Size☆17Jan 28, 2026Updated 9 months ago
- An imaginary extension of rotary position embeddings for long-context language models☆35Dec 9, 2025Updated 11 months ago
- [ICLR 2026] Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decoding☆37Jan 27, 2026Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A post-training framework for diffusion language models with supervised fine-tuning and reinforcement learning☆167Mar 30, 2026Updated 7 months ago
- [ICML 2026] Official implementation of "FOCUS: DLLMs Know How to Tame Their Compute Bound".☆20Aug 2, 2026Updated 3 months ago
- Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Princ…☆47Jul 18, 2025Updated last year
- [ICLR 2026] SparseD: Sparse Attention for Diffusion Language Models☆68Feb 22, 2026Updated 8 months ago
- [ACL 2026] Focus-dLLM: Accelerating Long-Context Diffusion LLM Inference via Confidence-Guided Context Focusing".☆14Nov 5, 2026Updated last week
- Unofficial Evaluation for LLaDA2.0-mini-preview with LM-eval☆11Nov 24, 2025Updated 11 months ago
- ☆54Apr 14, 2026Updated 7 months ago
- [ICLR'26] Official code of paper "d2Cache: Accelerating Diffusion-based LLMs via Dual Adaptive Caching"☆187May 14, 2026Updated 6 months ago
- [NeurIPS'25] dKV-Cache: The Cache for Diffusion Language Models☆137May 22, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICML 2026] Prism: Spectral-Aware Block-Sparse Attention☆27May 22, 2026Updated 5 months ago
- A training-free method for extending the maximum context length of language models☆14Oct 6, 2025Updated last year
- Official implementation of "DPad: Efficient Diffusion Language Models with Suffix Dropout"☆67Feb 13, 2026Updated 9 months ago
- Offical implementation of our paper "Exploring the Potential of Diffusion Large Language Models in Code Generation".☆23Sep 26, 2026Updated last month
- ☆31Aug 18, 2025Updated last year
- ☆116Nov 17, 2025Updated last year
- Advancing Block Diffusion Language Models for Test-Time Scaling☆16Feb 14, 2026Updated 9 months ago
- A Collection of Papers on Diffusion Language Models☆191Aug 2, 2026Updated 3 months ago
- Implementation of "Orchestrating Dual-Boundaries: An Arithmetic Intensity Inspired Acceleration Framework for Diffusion Language Models"☆25Dec 4, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Use the tokenizer in parallel to achieve superior acceleration☆20Mar 21, 2024Updated 2 years ago
- Nano vLLM☆11Feb 26, 2026Updated 8 months ago
- [NeurIPS 2026] Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models☆24Sep 29, 2026Updated last month
- Official implementation of ICML2025 paper "ToMA: Token Merge with Attention for Diffusion Models"☆22Aug 6, 2025Updated last year
- LightningRL: Breaking the Accuracy–Parallelism Trade-off of Block-wise dLLMs via Reinforcement Learning☆33Apr 25, 2026Updated 6 months ago
- Open diffusion language model for code generation — releasing pretraining, evaluation, inference, and checkpoints.☆665Jul 20, 2026Updated 3 months ago
- ☆146Aug 31, 2026Updated 2 months ago
- [NeurIPS 2024] Can Language Models Learn to Skip Steps?☆22Jan 25, 2025Updated last year
- Artifact for paper: ZipMoE☆18May 28, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LLaDA2.0 is the diffusion language model series developed by InclusionAI team, Ant Group.☆533Jul 22, 2026Updated 3 months ago
- SparseServe: Unlocking Parallelism for Dynamic Sparse Attention in Long-Context LLM Serving☆14Sep 30, 2025Updated last year
- graduate design for CS master, Beihang university.☆10Mar 21, 2018Updated 8 years ago
- code for Scaling Laws of RoPE-based Extrapolation☆73Oct 16, 2023Updated 3 years ago
- Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas☆121Feb 3, 2026Updated 9 months ago
- Official repository of: Attention Sinks in Diffusion Language Models☆12Dec 10, 2025Updated 11 months ago
- Flexible and Pluggable Serving Engine for Diffusion LLMs☆158Jul 13, 2026Updated 4 months ago
Are these results useful?