GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 training.
☆342Nov 11, 2025Updated 8 months ago
Alternatives and similar repositories for MegaDLMs
Users that are interested in MegaDLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official implementation of dLLM-Var☆35Nov 6, 2025Updated 8 months ago
- Offical implementation of our paper "Exploring the Potential of Diffusion Large Language Models in Code Generation".☆23Oct 29, 2025Updated 8 months ago
- The official github repo for "Diffusion Language Models are Super Data Learners".☆227Nov 6, 2025Updated 8 months ago
- The official github repo for "Training Optimal Large Diffusion Language Models", the first-ever large-scale diffusion language models sca…☆46Nov 6, 2025Updated 8 months ago
- Open diffusion language model for code generation — releasing pretraining, evaluation, inference, and checkpoints.☆641May 31, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Discrete Diffusion Forcing (D2F): dLLMs Can Do Faster-Than-AR Inference☆258Feb 3, 2026Updated 5 months ago
- Code for "Language Models Can Learn from Verbal Feedback Without Scalar Rewards"☆65Jan 5, 2026Updated 6 months ago
- [ICLR 2026] Official code for TraceRL: Revolutionizing post-training for Diffusion LLMs, powering the SOTA TraDo series.☆511Jan 28, 2026Updated 5 months ago
- ☆16Nov 5, 2025Updated 8 months ago
- Use the tokenizer in parallel to achieve superior acceleration☆20Mar 21, 2024Updated 2 years ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆84Jan 24, 2024Updated 2 years ago
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆1,056May 30, 2026Updated last month
- 🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support☆678Jul 5, 2026Updated last week
- Official PyTorch implementation for "Large Language Diffusion Models"☆3,885Jun 25, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas☆118Feb 3, 2026Updated 5 months ago
- [NeurIPS 2025] Encoder-Decoder Diffusion Language Models for Efficient Training and Inference☆45Oct 29, 2025Updated 8 months ago
- [NeurIPS'25] dKV-Cache: The Cache for Diffusion Language Models☆135May 22, 2025Updated last year
- Code for paper "SPG Sandwiched Policy Gradient for Masked Diffusion Language Models"☆61Oct 29, 2025Updated 8 months ago
- Implementation of "Reinforcing the Diffusion Chain of Lateral Thought with Diffusion Language Models" [NeurIPS 2025]☆82Dec 17, 2025Updated 6 months ago
- The Dataset and Official Implementation for <Discursive Socratic Questioning: Evaluating the Faithfulness of Language Models’ Understandi…☆18Aug 7, 2024Updated last year
- End-to-end pipeline for PPIFlow☆24Feb 17, 2026Updated 4 months ago
- The official GitHub repo for the survey paper "A Survey on Diffusion Language Models".☆1,120May 29, 2026Updated last month
- ☆19Oct 12, 2025Updated 9 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [NeurIPS 2025 Spotlight] A Token is Worth over 1,000 Tokens: Efficient Knowledge Distillation through Low-Rank Clone.☆48Oct 29, 2025Updated 8 months ago
- My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"☆13Nov 11, 2024Updated last year
- ☆32Jun 5, 2025Updated last year
- Modeling code for a BitNet b1.58 Llama-style model.☆25Apr 30, 2024Updated 2 years ago
- Code for the paper https://arxiv.org/abs/2205.14987v2☆66Apr 18, 2024Updated 2 years ago
- ☆18Dec 11, 2024Updated last year
- [NeurIPS'25] KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems☆17Nov 1, 2025Updated 8 months ago
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆47Sep 19, 2025Updated 9 months ago
- ☆11Jun 14, 2019Updated 7 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [MM 2022] MM-ALT: A Multimodal Automatic Lyric Transcription System (Oral, Top paper award)☆21Mar 16, 2024Updated 2 years ago
- Insights into the inner workings of transformer models for protein function prediction☆14Feb 9, 2024Updated 2 years ago
- Data recipes and robust infrastructure for training AI agents☆257Updated this week
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆53Oct 18, 2024Updated last year
- WeDLM: The fastest diffusion language model with standard causal attention and native KV cache compatibility, delivering real speedups ov…☆645Mar 3, 2026Updated 4 months ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆399May 31, 2025Updated last year
- Dream 7B, a large diffusion language model☆1,254Nov 21, 2025Updated 7 months ago