JinjieNi / MegaDLMsLinks
GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 training.
☆283Updated 2 weeks ago
Alternatives and similar repositories for MegaDLMs
Users that are interested in MegaDLMs are comparing it to the libraries listed below
Sorting:
- TraceRL & TraDo-8B: Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Models☆327Updated last week
- ☆324Updated 3 weeks ago
- The official github repo for "Diffusion Language Models are Super Data Learners".☆205Updated 3 weeks ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆336Updated 5 months ago
- Esoteric Language Models☆107Updated this week
- Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"☆362Updated 4 months ago
- The most open diffusion language model for code generation — releasing pretraining, evaluation, inference, and checkpoints.☆462Updated 2 weeks ago
- [NeurIPS 2025] Reinforcement Learning for Reasoning in Large Language Models with One Training Example☆381Updated last week
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆696Updated last month
- ☆112Updated last week
- Easy and Efficient dLLM Fine-Tuning☆76Updated this week
- Geometric-Mean Policy Optimization☆94Updated last week
- Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.☆125Updated 2 months ago
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆343Updated 11 months ago
- repo for paper https://arxiv.org/abs/2504.13837☆264Updated 5 months ago
- The official GitHub repo for the survey paper "A Survey on Diffusion Language Models".☆506Updated last week
- [NeurIPS 2025] The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆186Updated 4 months ago
- Discrete Diffusion Forcing (D2F): dLLMs Can Do Faster-Than-AR Inference☆202Updated 2 months ago
- Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models☆224Updated 3 weeks ago
- QeRL enables RL for 32B LLMs on a single H100 GPU.☆455Updated this week
- Towards a Unified View of Large Language Model Post-Training☆187Updated 2 months ago
- ☆103Updated 2 months ago
- Demystifying Reinforcement Learning in Agentic Reasoning☆121Updated last month
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆185Updated last week
- Official implementation of the NeurIPS 2025 paper "Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space"☆277Updated 2 weeks ago
- Defeating the Training-Inference Mismatch via FP16☆154Updated 2 weeks ago
- [NeurIPS 2025] Thinkless: LLM Learns When to Think☆243Updated 2 months ago
- RLP: Reinforcement as a Pretraining Objective☆201Updated last month
- 📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.☆280Updated 3 weeks ago
- ☆283Updated last month