kuleshov-group / mdlm
Simple and Effective Masked Diffusion Language Model
☆346Updated 2 weeks ago
Alternatives and similar repositories for mdlm:
Users that are interested in mdlm are comparing it to the libraries listed below
- [ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)☆530Updated last year
- A curated list for awesome discrete diffusion models resources.☆268Updated last month
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆117Updated this week
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆131Updated 3 months ago
- Some preliminary explorations of Mamba's context scaling.☆212Updated last year
- Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".☆101Updated this week
- ☆91Updated last year
- Minimal Implementation of a D3PM in pytorch☆205Updated 11 months ago
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆112Updated last month
- Official Jax Implementation of MD4 Masked Diffusion Models☆67Updated 3 weeks ago
- Normalized Transformer (nGPT)☆162Updated 4 months ago
- code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"☆777Updated last week
- ☆128Updated last year
- Educational implementation of the Discrete Flow Matching paper☆79Updated 6 months ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆132Updated 2 weeks ago
- Implementation of Autoregressive Diffusion in Pytorch☆364Updated 4 months ago
- Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]☆50Updated last month
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆205Updated 3 weeks ago
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆142Updated this week
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- Triton implementation of FlashAttention2 that adds Custom Masks.☆102Updated 7 months ago
- A summary of related works about flow matching, stochastic interpolants☆407Updated 7 months ago
- ☆172Updated last year
- Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data"☆33Updated last month
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI☆276Updated this week
- When it comes to optimizers, it's always better to be safe than sorry☆214Updated last month
- Implementation of rectified flow and some of its followup research / improvements in Pytorch☆263Updated last month
- This is the official code release for Bayesian Flow Networks.☆272Updated 8 months ago
- [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters☆535Updated last month