kuleshov-group / mdlm
Simple and Effective Masked Diffusion Language Model
☆376Updated 3 weeks ago
Alternatives and similar repositories for mdlm:
Users that are interested in mdlm are comparing it to the libraries listed below
- [ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)☆565Updated last year
- A curated list for awesome discrete diffusion models resources.☆309Updated 3 months ago
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆162Updated 4 months ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆158Updated last month
- Official Jax Implementation of MD4 Masked Diffusion Models☆78Updated 2 months ago
- Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"☆100Updated 2 weeks ago
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆569Updated 2 weeks ago
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆137Updated 2 months ago
- ☆95Updated last year
- Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".☆119Updated this week
- Educational implementation of the Discrete Flow Matching paper☆87Updated 8 months ago
- Minimal Implementation of a D3PM in pytorch☆216Updated last year
- ☆133Updated last year
- A minimal implementation of diffusion models for text generation☆360Updated last year
- Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]☆57Updated last week
- Code accompanying the paper "Generalized Interpolating Discrete Diffusion"☆77Updated last week
- Implementation of Autoregressive Diffusion in Pytorch☆374Updated 6 months ago
- code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"☆843Updated last month
- Some preliminary explorations of Mamba's context scaling.☆213Updated last year
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆147Updated 2 months ago
- Simple Guidance Mechanisms for Discrete Diffusion Models☆36Updated 4 months ago
- Muon optimizer: +>30% sample efficiency with <3% wallclock overhead☆597Updated last month
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆215Updated this week
- ☆175Updated last year
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆159Updated last month
- [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters☆555Updated 2 months ago
- This is the official code release for Bayesian Flow Networks.☆272Updated 9 months ago
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI☆281Updated last month
- Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data" (ICLR…☆37Updated 2 months ago
- A summary of related works about flow matching, stochastic interpolants☆441Updated last month