SonyResearch / micro_diffusion
Official repository for our work on micro-budget training of large-scale diffusion models.
☆1,397Updated 3 months ago
Alternatives and similar repositories for micro_diffusion:
Users that are interested in micro_diffusion are comparing it to the libraries listed below
- NanoGPT (124M) in 3 minutes☆2,520Updated last week
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,277Updated 2 weeks ago
- The simplest, fastest repository for training/finetuning small-sized VLMs.☆1,126Updated this week
- Code for BLT research paper☆1,558Updated this week
- UNet diffusion model in pure CUDA☆601Updated 10 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,445Updated 2 months ago
- nanoGPT style version of Llama 3.1☆1,363Updated 9 months ago
- Schedule-Free Optimization in PyTorch☆2,150Updated 3 weeks ago
- Simple and readable code for training and sampling from diffusion models☆487Updated 3 months ago
- Official implementation of Inductive Moment Matching☆458Updated last month
- The Autograd Engine☆603Updated 7 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆867Updated last week
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆517Updated 10 months ago
- The Multilayer Perceptron Language Model☆547Updated 8 months ago
- 4M: Massively Multimodal Masked Modeling☆1,719Updated 2 months ago
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,275Updated 2 weeks ago
- The n-gram Language Model☆1,419Updated 9 months ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆424Updated 4 months ago
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!☆728Updated last week
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,048Updated 3 months ago
- Large Concept Models: Language modeling in a sentence representation space☆2,131Updated 3 months ago
- Muon optimizer: +>30% sample efficiency with <3% wallclock overhead☆611Updated last month
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆569Updated 3 weeks ago
- Helpful tools and examples for working with flex-attention☆757Updated this week
- The Tensor (or Array)☆432Updated 8 months ago
- A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes…☆2,491Updated 4 months ago
- Train high-quality text-to-image diffusion models in a data & compute efficient manner☆491Updated last month
- A suite of image and video neural tokenizers☆1,621Updated 2 months ago
- Implementation of Diffusion Transformer (DiT) in JAX☆272Updated 10 months ago
- Code release for "LLMs can see and hear without any training"☆429Updated 2 months ago