The official github repo for "Diffusion Language Models are Super Data Learners".
☆223Nov 6, 2025Updated 4 months ago
Alternatives and similar repositories for dlms-are-super-data-learners
Users that are interested in dlms-are-super-data-learners are comparing it to the libraries listed below
Sorting:
- The official github repo for "Training Optimal Large Diffusion Language Models", the first-ever large-scale diffusion language models sca…☆45Nov 6, 2025Updated 4 months ago
- A lightweight Inference Engine built for block diffusion models☆42Dec 9, 2025Updated 3 months ago
- GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…☆328Nov 11, 2025Updated 4 months ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆85May 26, 2025Updated 9 months ago
- [Arxiv] Discrete Diffusion in Large Language and Multimodal Models: A Survey☆374Nov 1, 2025Updated 4 months ago
- FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones☆64Jan 26, 2026Updated last month
- ☆33Jan 6, 2025Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆42Dec 29, 2025Updated 2 months ago
- MMaDA - Open-Sourced Multimodal Large Diffusion Language Models (dLLMs with block diffusion, mixed-CoT, unified RL)☆1,610Feb 14, 2026Updated last month
- SDAR (Synergy of Diffusion and AutoRegression), a large diffusion language model（1.7B, 4B, 8B, 30B）☆342Updated this week
- This repository provides an improved LLamaGen Model, fine-tuned on 500,000 high-quality images, each accompanied by over 300 token prompt…☆30Oct 21, 2024Updated last year
- Esoteric Language Models☆114Feb 8, 2026Updated last month
- [ICLR 2026] Official code for TraceRL: Revolutionizing post-training for Diffusion LLMs, powering the SOTA TraDo series.☆464Jan 28, 2026Updated last month
- Transition Models☆146Oct 7, 2025Updated 5 months ago
- [Preprint] Efficient Generative Model Training via Embedded Representation Warmup☆36Oct 15, 2025Updated 5 months ago
- Official PyTorch implementation for "Large Language Diffusion Models"☆3,682Nov 12, 2025Updated 4 months ago
- ☆30Oct 7, 2024Updated last year
- LoPA: Scaling dLLM Inference via Lookahead Parallel Decoding☆36Jan 16, 2026Updated 2 months ago
- [CVPR 2025] Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis☆131May 16, 2025Updated 10 months ago
- Dream 7B, a large diffusion language model☆1,198Nov 21, 2025Updated 3 months ago
- [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆190Sep 26, 2025Updated 5 months ago
- 🔥 A minimal training framework for scaling FLA models☆357Nov 15, 2025Updated 4 months ago
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆120Jan 10, 2026Updated 2 months ago
- [NeurIPS 2024] Simple and Effective Masked Diffusion Language Model☆654Sep 29, 2025Updated 5 months ago
- Any-Order GPT as Masked Diffusion Model: Decoupling Formulation and Architecture. Training an MDM using GPT with this repo!☆34Jun 23, 2025Updated 8 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆92Oct 30, 2024Updated last year
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆372Dec 22, 2024Updated last year
- DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation☆803Jul 9, 2025Updated 8 months ago
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆331Jan 5, 2026Updated 2 months ago
- Single-pass Adaptive Image Tokenization for Minimum Program Search | What's the Kolmogorov Complexity of an Image?☆42Jul 26, 2025Updated 7 months ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆206Mar 4, 2025Updated last year
- Don't just regulate gradients like in Muon, regulate the weights too☆31Jul 30, 2025Updated 7 months ago
- Exploring how ChatGPT can be used to accelerate research in cosmology.☆12Dec 12, 2022Updated 3 years ago
- Code for paper "SPG Sandwiched Policy Gradient for Masked Diffusion Language Models"☆52Oct 29, 2025Updated 4 months ago
- The evaluation framework for training-free sparse attention in LLMs☆122Jan 27, 2026Updated last month
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆89Sep 26, 2024Updated last year
- 🚀 Efficient implementations of state-of-the-art linear attention models☆4,630Updated this week
- Here we will test various linear attention designs.☆62Apr 25, 2024Updated last year
- The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]☆21Feb 27, 2025Updated last year