Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
☆57Mar 10, 2025Updated 11 months ago
Alternatives and similar repositories for nano-mdm
Users that are interested in nano-mdm are comparing it to the libraries listed below
Sorting:
- Focused on fast experimentation and simplicity☆80Dec 24, 2024Updated last year
- [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers☆15Feb 12, 2026Updated 3 weeks ago
- ☆27May 3, 2024Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated last year
- ☆33Jan 6, 2025Updated last year
- Minimal Implementation of a D3PM in pytorch☆287Apr 22, 2024Updated last year
- ☆15Mar 1, 2022Updated 4 years ago
- ☆34Sep 10, 2024Updated last year
- ☆33Nov 4, 2024Updated last year
- ☆53Jan 6, 2024Updated 2 years ago
- ☆19Dec 31, 2025Updated 2 months ago
- Code for the paper "Function-Space Learning Rates"☆25Jun 3, 2025Updated 9 months ago
- Applying "Load What You Need: Smaller Versions of Multilingual BERT" to LaBSE☆19Sep 22, 2021Updated 4 years ago
- [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"☆10Jul 19, 2024Updated last year
- [Preprint] GMem: A Modular Approach for Ultra-Efficient Generative Models☆43Mar 11, 2025Updated 11 months ago
- ☆23Jun 18, 2024Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyers☆73Apr 22, 2025Updated 10 months ago
- ☆24Sep 25, 2024Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- ☆48Feb 23, 2025Updated last year
- An approximate implementation of the OpenAI paper - An Empirical Model of Large-Batch Training for MNIST☆11Nov 19, 2022Updated 3 years ago
- WIP☆94Aug 13, 2024Updated last year
- "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…☆31May 7, 2024Updated last year
- ☆24Jun 4, 2024Updated last year
- [ICCV 2025] Official Implementation of Contrastive Flow Matching☆164Jun 25, 2025Updated 8 months ago
- [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens☆25Nov 6, 2023Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Jun 21, 2023Updated 2 years ago
- ☆114May 29, 2023Updated 2 years ago
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆34Feb 27, 2025Updated last year
- ☆12Jan 4, 2024Updated 2 years ago
- recipe for training fully-featured self supervised image jepa models☆12Jun 4, 2025Updated 9 months ago
- ☆11Jan 16, 2024Updated 2 years ago
- Official Implementation of Nabla-GFlowNet (ICLR 2025)☆28May 3, 2025Updated 10 months ago
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆635Jul 1, 2024Updated last year
- ☆46Oct 11, 2023Updated 2 years ago
- StyleTTS 2 Optimized Training Fork☆33Feb 2, 2025Updated last year
- ☆13Sep 13, 2023Updated 2 years ago
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆86Jul 28, 2024Updated last year
- ☆124May 28, 2024Updated last year