Alternatives and similar repositories for SMDM:

Users that are interested in SMDM are comparing it to the libraries listed below

• HKUNLP / DiffuLLaMA
  [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆154Updated last month
• dllm-reasoning / d1
  Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"
  ☆39Updated this week
• ML-GSAI / RADD
  Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data"
  ☆37Updated last month
• kuleshov-group / mdlm
  Simple and Effective Masked Diffusion Language Model
  ☆366Updated this week
• HKUNLP / diffusion-of-thoughts
  [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"
  ☆144Updated last month
• bansky-cl / diffusion-nlp-paper-arxiv
  Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".
  ☆110Updated this week
• igul222 / plaid
  ☆95Updated last year
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆47Updated 2 months ago
• kuleshov-group / bd3lms
  Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
  ☆519Updated this week
• zacharyhorvitz / Fk-Diffusion-Steering
  A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.
  ☆124Updated 2 months ago
• dvruette / gidd
  Code accompanying the paper "Generalized Interpolating Discrete Diffusion"
  ☆73Updated 3 weeks ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆164Updated 3 months ago
• haonan3 / AnchorContext
  AnchorAttention: Improved attention for LLMs long-context training
  ☆206Updated 3 months ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆212Updated 2 weeks ago
• bansky-cl / Diffusion-LM-Papers
  Listing some diffusion papers in NLP domain I have read, text generation is main, table will continue to be updated.
  ☆40Updated 3 weeks ago
• google-deepmind / md4
  Official Jax Implementation of MD4 Masked Diffusion Models
  ☆74Updated last month
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆123Updated 11 months ago
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆76Updated last year
• ozekri / SEPO
  Code for the paper: "Fine-Tuning Discrete Diffusion Models with Policy Gradient Methods"
  ☆19Updated last month
• sustcsonglin / linear-attention-and-beyond-slides
  ☆67Updated last month
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆90Updated last week
• thu-ml / Noise-Contrastive-Alignment
  Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)
  ☆51Updated 5 months ago
• NVlabs / GatedDeltaNet
  [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule
  ☆152Updated last month
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆50Updated last month
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆82Updated 6 months ago
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆103Updated 7 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆180Updated last month
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆212Updated last year
• GAIR-NLP / LIMR
  ☆184Updated last month
• liusulin / DDPD
  Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]
  ☆56Updated 3 weeks ago