SonyResearch / micro_diffusion
Official repository for our work on micro-budget training of large-scale diffusion models.
☆1,375Updated 3 months ago
Alternatives and similar repositories for micro_diffusion:
Users that are interested in micro_diffusion are comparing it to the libraries listed below
- UNet diffusion model in pure CUDA☆601Updated 9 months ago
- NanoGPT (124M) in 3 minutes☆2,479Updated 2 weeks ago
- Simple and readable code for training and sampling from diffusion models☆471Updated 3 months ago
- nanoGPT style version of Llama 3.1☆1,351Updated 8 months ago
- Schedule-Free Optimization in PyTorch☆2,135Updated this week
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆508Updated 9 months ago
- Code for BLT research paper☆1,445Updated last week
- The Autograd Engine☆596Updated 7 months ago
- The Multilayer Perceptron Language Model☆544Updated 8 months ago
- 4M: Massively Multimodal Masked Modeling☆1,713Updated last month
- The Tensor (or Array)☆429Updated 8 months ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,684Updated 8 months ago
- PyTorch native quantization and sparsity for training and inference☆1,954Updated this week
- Official implementation of Inductive Moment Matching☆444Updated last month
- A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes…☆2,359Updated 3 months ago
- A suite of image and video neural tokenizers☆1,612Updated 2 months ago
- Train high-quality text-to-image diffusion models in a data & compute efficient manner☆491Updated 3 weeks ago
- Thunder gives you PyTorch models superpowers for training and inference. Unlock out-of-the-box optimizations for performance, memory and …☆1,323Updated this week
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,260Updated 4 months ago
- FastVideo is a lightweight framework for accelerating large video diffusion models.☆1,324Updated this week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆987Updated last month
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆519Updated this week
- Implementation of Diffusion Transformer (DiT) in JAX☆270Updated 10 months ago
- A PyTorch native library for large model training☆3,587Updated this week
- MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.☆1,287Updated last week
- Helpful tools and examples for working with flex-attention☆720Updated this week
- Everything about the SmolLM2 and SmolVLM family of models☆2,177Updated 2 weeks ago
- Puzzles for learning Triton☆1,566Updated 4 months ago
- Tile primitives for speedy kernels☆2,259Updated this week
- For optimization algorithm research and development.☆507Updated this week