Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
☆56Mar 10, 2025Updated last year
Alternatives and similar repositories for nano-mdm
Users that are interested in nano-mdm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Focused on fast experimentation and simplicity☆77Dec 24, 2024Updated last year
- LLaDA implementation☆19Jul 24, 2025Updated last year
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 10 months ago
- ☆19Dec 31, 2025Updated 10 months ago
- ☆33Jan 6, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- [EMNLP 2026] MDM-Prime-v2: Binary Encoding and Index Shuffling Enable Scaling of Diffusion Language Models☆30Oct 6, 2026Updated last month
- ☆53Jan 6, 2024Updated 2 years ago
- Remasking Discrete Diffusion Models with Inference-Time Scaling☆79Feb 7, 2026Updated 9 months ago
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆216May 1, 2026Updated 6 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Apr 22, 2025Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆112Mar 7, 2025Updated last year
- Comparative study and experimentation on standard vs mHC vs attention residual (full and block)☆13Mar 17, 2026Updated 7 months ago
- ☆26May 3, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆30Dec 2, 2024Updated last year
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆390Dec 22, 2024Updated last year
- Official Jax Implementation of MD4 Masked Diffusion Models☆163Feb 27, 2025Updated last year
- Official Implementation of Nabla-GFlowNet (ICLR 2025)☆28May 3, 2025Updated last year
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆32Feb 27, 2025Updated last year
- supporting pytorch FSDP for optimizers☆85Dec 8, 2024Updated last year
- ☆116May 29, 2023Updated 3 years ago
- ☆24Jun 4, 2024Updated 2 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆644Jul 1, 2024Updated 2 years ago
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated 2 years ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆84Jan 24, 2024Updated 2 years ago
- [NeurIPS 2024] Simple and Effective Masked Diffusion Language Model☆724Sep 29, 2025Updated last year
- Official Implementation for "Editing Massive Concepts in Text-to-Image Diffusion Models"☆19Mar 21, 2024Updated 2 years ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆213Mar 4, 2025Updated last year
- WIP☆97Aug 13, 2024Updated 2 years ago
- Official implementation for "Let Offline RL Flow: Training Conservative Agents in the Latent Space of Normalizing Flows", NeurIPS 2022, O…☆12Jan 31, 2023Updated 3 years ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆407May 31, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A training-free framework that accelerates diffusion language models through dynamic cache eviction and sparse attention☆30Oct 16, 2025Updated last year
- ☆13Jul 12, 2024Updated 2 years ago
- Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data" (ICLR…☆84May 30, 2025Updated last year
- ☆10Dec 2, 2024Updated last year
- Official implementation of Inductive Moment Matching☆586Jul 11, 2025Updated last year
- A trainable activation function incorporating sine waves☆10Jun 8, 2021Updated 5 years ago
- graduate design for CS master, Beihang university.☆10Mar 21, 2018Updated 8 years ago