HKUNLP / DiffuLLaMALinks
[ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
☆234Updated last month
Alternatives and similar repositories for DiffuLLaMA
Users that are interested in DiffuLLaMA are comparing it to the libraries listed below
Sorting:
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆248Updated 6 months ago
- Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"☆235Updated 2 weeks ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆169Updated 4 months ago
- ☆318Updated last month
- AnchorAttention: Improved attention for LLMs long-context training☆208Updated 6 months ago
- paper list, tutorial, and nano code snippet for Diffusion Large Language Models.☆82Updated 2 weeks ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆177Updated 3 weeks ago
- Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data" (ICLR…☆54Updated last month
- [NeurIPS 2024] Simple and Effective Masked Diffusion Language Model☆447Updated last month
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆75Updated last month
- Large Language Diffusion with Ordered Unmasking☆38Updated last month
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆222Updated 2 months ago
- A collection of papers on discrete diffusion models☆151Updated 2 weeks ago
- Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".☆146Updated this week
- ☆171Updated 2 weeks ago
- ☆90Updated 2 months ago
- ☆103Updated 2 years ago
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆83Updated 6 months ago
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆65Updated 5 months ago
- Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)☆54Updated 8 months ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆81Updated last year
- A Collection of Papers on Diffusion Language Models☆90Updated last week
- official repository for “Reinforcement Learning for Reasoning in Large Language Models with One Training Example”☆323Updated this week
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆726Updated this week
- Some preliminary explorations of Mamba's context scaling.☆215Updated last year
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆278Updated last week
- A repo for open research on building large reasoning models☆68Updated this week
- Listing some diffusion papers in NLP domain I have read, text generation is main, table will continue to be updated.☆51Updated 3 months ago
- Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training☆284Updated 2 months ago
- repo for paper https://arxiv.org/abs/2504.13837☆168Updated 2 weeks ago