HKUNLP / DiffuLLaMA
[ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
☆158Updated last month
Alternatives and similar repositories for DiffuLLaMA:
Users that are interested in DiffuLLaMA are comparing it to the libraries listed below
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆165Updated 4 months ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆147Updated 2 months ago
- Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"☆100Updated 3 weeks ago
- Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data" (ICLR…☆37Updated 2 months ago
- ☆77Updated 2 weeks ago
- Simple and Effective Masked Diffusion Language Model☆376Updated 3 weeks ago
- ☆69Updated 2 months ago
- ☆95Updated last year
- AnchorAttention: Improved attention for LLMs long-context training☆207Updated 3 months ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆76Updated last year
- ☆92Updated 7 months ago
- A brief and partial summary of RLHF algorithms.☆128Updated 2 months ago
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆52Updated 2 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆84Updated 7 months ago
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"☆84Updated this week
- Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"☆123Updated last year
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆215Updated this week
- Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)☆51Updated 6 months ago
- Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]☆58Updated 2 weeks ago
- Some preliminary explorations of Mamba's context scaling.☆213Updated last year
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch