fal-ai-community / nano-mdm
Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
☆44Updated 3 weeks ago
Alternatives and similar repositories for nano-mdm:
Users that are interested in nano-mdm are comparing it to the libraries listed below
- Focused on fast experimentation and simplicity☆70Updated 3 months ago
- research impl of Native Sparse Attention (2502.11089)☆53Updated last month
- ☆27Updated 11 months ago
- ☆74Updated 7 months ago
- Code accompanying the paper "Generalized Interpolating Discrete Diffusion"☆69Updated 2 weeks ago
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆115Updated last month
- ☆24Updated 4 months ago
- Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆15Updated 2 months ago
- supporting pytorch FSDP for optimizers☆80Updated 3 months ago
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆73Updated 8 months ago
- ☆33Updated 6 months ago
- ☆22Updated 9 months ago
- WIP☆93Updated 7 months ago
- ☆51Updated last year
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆26Updated 3 weeks ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆26Updated 6 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆75Updated 4 months ago
- Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)☆45Updated 4 months ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆55Updated 10 months ago
- ☆32Updated 5 months ago
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆23Updated 2 months ago
- ☆76Updated 8 months ago
- Minimal Implementation of Visual Autoregressive Modelling (VAR)☆29Updated last week
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆24Updated 4 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆123Updated 11 months ago
- ☆91Updated last year
- Triton Implementation of HyperAttention Algorithm☆47Updated last year
- Collection of autoregressive model implementation☆83Updated last month
- ☆21Updated 4 months ago
- Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public☆80Updated last month