SonyResearch / micro_diffusion
Official repository for our work on micro-budget training of large-scale diffusion models.
☆1,356Updated 2 months ago
Alternatives and similar repositories for micro_diffusion:
Users that are interested in micro_diffusion are comparing it to the libraries listed below
- Schedule-Free Optimization in PyTorch☆2,116Updated 3 weeks ago
- NanoGPT (124M) in 3 minutes☆2,403Updated this week
- Simple and readable code for training and sampling from diffusion models☆445Updated 2 months ago
- UNet diffusion model in pure CUDA☆600Updated 8 months ago
- nanoGPT style version of Llama 3.1☆1,341Updated 7 months ago
- A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes…☆2,206Updated 2 months ago
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆491Updated 8 months ago
- A suite of image and video neural tokenizers☆1,579Updated last month
- 4M: Massively Multimodal Masked Modeling☆1,701Updated 2 weeks ago
- Code for BLT research paper☆1,436Updated this week
- Everything about the SmolLM2 and SmolVLM family of models☆2,035Updated last week
- Train high-quality text-to-image diffusion models in a data & compute efficient manner☆483Updated last month
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆855Updated last month
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆1,952Updated 7 months ago
- A PyTorch native library for large model training☆3,470Updated this week
- The Multilayer Perceptron Language Model☆543Updated 7 months ago
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,746Updated 3 months ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,620Updated 7 months ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆419Updated 3 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆948Updated 2 weeks ago
- Implementation of Diffusion Transformer (DiT) in JAX☆269Updated 9 months ago
- PyTorch native quantization and sparsity for training and inference☆1,913Updated this week
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,241Updated 4 months ago
- Puzzles for learning Triton☆1,527Updated 4 months ago
- The n-gram Language Model☆1,402Updated 7 months ago
- PyTorch video decoding☆457Updated this week
- Distributed Training Over-The-Internet☆888Updated 3 months ago
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,530Updated this week