ML-GSAI / SMDM
Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"
☆165Updated 4 months ago
Alternatives and similar repositories for SMDM:
Users that are interested in SMDM are comparing it to the libraries listed below
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆160Updated last month
- Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"☆127Updated this week
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆147Updated 2 months ago
- Simple and Effective Masked Diffusion Language Model☆376Updated 3 weeks ago
- AnchorAttention: Improved attention for LLMs long-context training☆207Updated 3 months ago
- Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".☆122Updated this week
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆54Updated 2 months ago
- ☆95Updated last year
- Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data" (ICLR…☆37Updated 2 months ago
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆216Updated last week
- Code accompanying the paper "Generalized Interpolating Discrete Diffusion"☆78Updated this week
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆165Updated 4 months ago
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆587Updated 3 weeks ago
- A brief and partial summary of RLHF algorithms.☆128Updated 2 months ago
- Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)☆51Updated 6 months ago
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆140Updated 2 months ago
- Code for the paper: "Fine-Tuning Discrete Diffusion Models with Policy Gradient Methods"☆20Updated 2 months ago
- [ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)☆571Updated last year
- Listing some diffusion papers in NLP domain I have read, text generation is main, table will continue to be updated.☆42Updated last month
- Code for "Reasoning to Learn from Latent Thoughts"☆93Updated last month
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆156Updated 3 weeks ago
- Dream 7B, a large diffusion language model☆622Updated last week
- Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]☆58Updated 2 weeks ago
- Some preliminary explorations of Mamba's context scaling.☆213Updated last year
- ☆71Updated 2 months ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆77Updated last year
- Stick-breaking attention☆52Updated last month
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"☆84Updated this week
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆84Updated 7 months ago
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆99Updated last month