The official github repo for "Diffusion Language Models are Super Data Learners".
☆225Nov 6, 2025Updated 5 months ago
Alternatives and similar repositories for dlms-are-super-data-learners
Users that are interested in dlms-are-super-data-learners are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official github repo for "Training Optimal Large Diffusion Language Models", the first-ever large-scale diffusion language models sca…☆46Nov 6, 2025Updated 5 months ago
- A lightweight Inference Engine built for block diffusion models☆43Dec 9, 2025Updated 4 months ago
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆29Aug 19, 2025Updated 7 months ago
- GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…☆331Nov 11, 2025Updated 4 months ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆87May 26, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- [ICLR 2026] Official code for TraceRL: Revolutionizing post-training for Diffusion LLMs, powering the SOTA TraDo series.☆480Jan 28, 2026Updated 2 months ago
- [Arxiv] Discrete Diffusion in Large Language and Multimodal Models: A Survey☆374Nov 1, 2025Updated 5 months ago
- FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones☆65Jan 26, 2026Updated 2 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆42Dec 29, 2025Updated 3 months ago
- Weird autoencoder experiments☆24Jan 26, 2026Updated 2 months ago
- MMaDA - Open-Sourced Multimodal Large Diffusion Language Models (dLLMs with block diffusion, mixed-CoT, unified RL)☆1,620Feb 14, 2026Updated last month
- SDAR (Synergy of Diffusion and AutoRegression), a large diffusion language model（1.7B, 4B, 8B, 30B）☆346Mar 16, 2026Updated 3 weeks ago
- Esoteric Language Models☆115Mar 27, 2026Updated 2 weeks ago
- Transition Models☆146Oct 7, 2025Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Official PyTorch implementation for "Large Language Diffusion Models"☆3,710Nov 12, 2025Updated 4 months ago
- [Preprint] Efficient Generative Model Training via Embedded Representation Warmup☆36Oct 15, 2025Updated 5 months ago
- ☆30Oct 7, 2024Updated last year
- LoPA: Scaling dLLM Inference via Lookahead Parallel Decoding☆36Updated this week
- [CVPR 2025] Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis☆133May 16, 2025Updated 10 months ago
- Dream 7B, a large diffusion language model☆1,211Nov 21, 2025Updated 4 months ago
- [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆192Sep 26, 2025Updated 6 months ago
- 🔥 A minimal training framework for scaling FLA models☆363Nov 15, 2025Updated 4 months ago
- [NeurIPS 2024] Simple and Effective Masked Diffusion Language Model☆670Sep 29, 2025Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆123Jan 10, 2026Updated 3 months ago
- Any-Order GPT as Masked Diffusion Model: Decoupling Formulation and Architecture. Training an MDM using GPT with this repo!☆35Jun 23, 2025Updated 9 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆92Oct 30, 2024Updated last year
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆375Dec 22, 2024Updated last year
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆334Jan 5, 2026Updated 3 months ago
- DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation☆811Jul 9, 2025Updated 9 months ago
- Single-pass Adaptive Image Tokenization for Minimum Program Search | What's the Kolmogorov Complexity of an Image?☆42Jul 26, 2025Updated 8 months ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆206Mar 4, 2025Updated last year
- Don't just regulate gradients like in Muon, regulate the weights too☆32Jul 30, 2025Updated 8 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Code for paper "SPG Sandwiched Policy Gradient for Masked Diffusion Language Models"☆55Oct 29, 2025Updated 5 months ago
- The evaluation framework for training-free sparse attention in LLMs☆122Jan 27, 2026Updated 2 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆117Sep 26, 2024Updated last year
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆478May 17, 2025Updated 10 months ago
- 🚀 Efficient implementations for emerging model architectures☆4,823Updated this week
- Here we will test various linear attention designs.☆62Apr 25, 2024Updated last year
- The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]☆21Feb 27, 2025Updated last year