ML-GSAI / SMDM
Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"
☆131Updated 3 months ago
Alternatives and similar repositories for SMDM:
Users that are interested in SMDM are comparing it to the libraries listed below
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆117Updated this week
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆132Updated 2 weeks ago
- Simple and Effective Masked Diffusion Language Model☆346Updated 3 weeks ago
- Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".☆101Updated this week
- Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data"☆33Updated last month
- ☆91Updated last year
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆112Updated last month
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆43Updated last month
- Stick-breaking attention☆48Updated last week
- AnchorAttention: Improved attention for LLMs long-context training☆206Updated 2 months ago
- [ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)☆530Updated last year
- Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]☆50Updated last month
- Reparameterized Discrete Diffusion Models for Text Generation☆96Updated 2 years ago
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆205Updated 3 weeks ago
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆397Updated this week
- Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)☆50Updated 4 months ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆72Updated last year
- ☆63Updated last month
- Listing some diffusion papers in NLP domain I have read, text generation is main, table will continue to be updated.☆37Updated this week
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆160Updated 2 months ago
- Implementation of a multimodal diffusion transformer in Pytorch☆101Updated 9 months ago
- Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"☆123Updated 10 months ago
- ☆84Updated 5 months ago
- ☆128Updated last year
- ☆71Updated this week
- Official Jax Implementation of MD4 Masked Diffusion Models☆67Updated 3 weeks ago
- Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…☆100Updated 6 months ago
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆65Updated 3 months ago
- This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.☆102Updated 8 months ago
- [IJCAI'23] The official Github page of the paper "Diffusion Models for Non-autoregressive Text Generation: A Survey".☆27Updated last year