Methods and code for extending the context length of diffusion language models
☆56Dec 7, 2025Updated 9 months ago
Alternatives and similar repositories for LongLLaDA
Users that are interested in LongLLaDA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- We introduce UltraLLaDA , a scaled variant of LLaDA-8B-Base that extends the context length up to 128K tokens with light-weight post-trai…☆15Oct 23, 2025Updated 10 months ago
- A training-free framework that accelerates diffusion language models through dynamic cache eviction and sparse attention☆29Oct 16, 2025Updated 11 months ago
- An imaginary extension of rotary position embeddings for long-context language models☆33Dec 9, 2025Updated 9 months ago
- ☆55Apr 14, 2026Updated 5 months ago
- Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"☆457Aug 30, 2026Updated 2 weeks ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas☆119Feb 3, 2026Updated 7 months ago
- [ICLR 2026] SparseD: Sparse Attention for Diffusion Language Models☆68Feb 22, 2026Updated 6 months ago
- MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models☆46Jan 28, 2026Updated 7 months ago
- [NeurIPS'25] dKV-Cache: The Cache for Diffusion Language Models☆136May 22, 2025Updated last year
- [NeurIPS 2024] Can Language Models Learn to Skip Steps?☆22Jan 25, 2025Updated last year
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆1,088May 30, 2026Updated 3 months ago
- [ICML 2026] Sparser Block-Sparse Attention via Token Permutation☆33May 22, 2026Updated 3 months ago
- Official Implementation of wd1☆33Sep 25, 2025Updated 11 months ago
- A Collection of Papers on Diffusion Language Models☆186Aug 2, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Codes for Paper: From Hypergraph Energy Functions to Hypergraph Neural Networks☆23Jun 29, 2023Updated 3 years ago
- A survey of long-context language models covering architecture, infrastructure, training, and evaluation☆64Mar 31, 2025Updated last year
- ☆112Nov 17, 2025Updated 10 months ago
- A post-training framework for diffusion language models with supervised fine-tuning and reinforcement learning☆165Mar 30, 2026Updated 5 months ago
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆214May 1, 2026Updated 4 months ago
- ☆56May 16, 2026Updated 4 months ago
- Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models☆24May 19, 2026Updated 4 months ago
- [ICLR'26] Official PyTorch implementation of "Time Is a Feature: Exploiting Temporal Dynamics in Diffusion Language Models".☆66Mar 5, 2026Updated 6 months ago
- ☆352Mar 23, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The official github repo for "Diffusion Language Models are Super Data Learners".☆228Nov 6, 2025Updated 10 months ago
- Tracking the latest and greatest research papers on diffusion large language models.☆32Mar 13, 2026Updated 6 months ago
- ☆31Aug 18, 2025Updated last year
- Open diffusion language model for code generation — releasing pretraining, evaluation, inference, and checkpoints.☆656Jul 20, 2026Updated last month
- Towards Systematic Measurement for Long Text Quality☆39Sep 5, 2024Updated 2 years ago
- Code for paper "SPG Sandwiched Policy Gradient for Masked Diffusion Language Models"☆66Oct 29, 2025Updated 10 months ago
- Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Princ…☆46Jul 18, 2025Updated last year
- Awesome-Parallel-Reasoning: Unlocking the reasoning potential of LLMs. Papers, Code, Resources & Survey.☆56Mar 8, 2026Updated 6 months ago
- [AAAI 2026 Oral] SAMCL: Empowering SAM to Continually Learn from Dynamic Domains with Extreme Storage Efficiency☆21Mar 25, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- code for Scaling Laws of RoPE-based Extrapolation☆73Oct 16, 2023Updated 2 years ago
- The official implementation of dLLM-Var☆35Nov 6, 2025Updated 10 months ago
- Implementation of Flash-DLM (paper: FlashDLM: Accelerating Diffusion Language Models via Efficient KV Caching and Guided Diffusion). Prov…☆25Nov 25, 2025Updated 9 months ago
- [NeurIPS 2025] HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models☆30Feb 19, 2026Updated 7 months ago
- Reinforcement learning for improving embodied task planning in large language models☆28Mar 30, 2026Updated 5 months ago
- SDAR (Synergy of Diffusion and AutoRegression), a large diffusion language model（1.7B, 4B, 8B, 30B）☆528Jul 29, 2026Updated last month
- Dimple, the first Discrete Diffusion Multimodal Large Language Model☆117Aug 23, 2026Updated 3 weeks ago