SJTU-DENG-Lab / Discrete-Diffusion-ForcingLinks
Discrete Diffusion Forcing (D2F): dLLMs Can Do Faster-Than-AR Inference
☆241Updated this week
Alternatives and similar repositories for Discrete-Diffusion-Forcing
Users that are interested in Discrete-Diffusion-Forcing are comparing it to the libraries listed below
Sorting:
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆197Updated 2 months ago
- The most open diffusion language model for code generation — releasing pretraining, evaluation, inference, and checkpoints.☆510Updated 2 months ago
- ☆142Updated 2 weeks ago
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆825Updated last week
- [ICLR 2026] TraceRL & TraDo-8B: Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Models☆423Updated last week
- ☆221Updated 2 months ago
- Efficient triton implementation of Native Sparse Attention.☆262Updated 8 months ago
- paper list, tutorial, and nano code snippet for Diffusion Large Language Models.☆153Updated 2 weeks ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆362Updated 8 months ago
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆269Updated 7 months ago
- d3LLM: Ultra-Fast Diffusion LLM 🚀☆90Updated this week
- [NeurIPS'25] dKV-Cache: The Cache for Diffusion Language Models☆129Updated 8 months ago
- ☆270Updated 8 months ago
- SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention☆260Updated 3 weeks ago
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆108Updated 8 months ago
- Easy and Efficient dLLM Fine-Tuning☆208Updated 2 weeks ago
- A sparse attention kernel supporting mix sparse patterns☆453Updated 3 weeks ago
- Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)☆690Updated 4 months ago
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆446Updated 4 months ago
- Fast and memory-efficient exact kmeans☆138Updated this week
- [ICML 2025] SparseLoRA: Accelerating LLM Fine-Tuning with Contextual Sparsity☆70Updated 7 months ago
- Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"☆402Updated 2 weeks ago
- ☆120Updated this week
- 🔥 A minimal training framework for scaling FLA models☆343Updated 2 months ago
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆105Updated last year
- Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP☆93Updated 5 months ago
- A Collection of Papers on Diffusion Language Models☆155Updated 4 months ago
- ☆318Updated last month
- GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…☆321Updated 2 months ago
- Triton implementation of FlashAttention2 that adds Custom Masks.☆165Updated last year