SonyResearch / micro_diffusion
Official repository for our work on micro-budget training of large-scale diffusion models.
☆1,384Updated 3 months ago
Alternatives and similar repositories for micro_diffusion:
Users that are interested in micro_diffusion are comparing it to the libraries listed below
- Schedule-Free Optimization in PyTorch☆2,135Updated last week
- UNet diffusion model in pure CUDA☆601Updated 9 months ago
- nanoGPT style version of Llama 3.1☆1,351Updated 8 months ago
- NanoGPT (124M) in 3 minutes☆2,493Updated 2 weeks ago
- 4M: Massively Multimodal Masked Modeling☆1,713Updated last month
- A suite of image and video neural tokenizers☆1,612Updated 2 months ago
- Simple and readable code for training and sampling from diffusion models☆478Updated 3 months ago
- A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes…☆2,359Updated 3 months ago
- Code for BLT research paper☆1,445Updated last week
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆513Updated 9 months ago
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆1,980Updated 8 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆987Updated last month
- For optimization algorithm research and development.☆507Updated this week
- The Multilayer Perceptron Language Model☆543Updated 8 months ago
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆1,407Updated 3 weeks ago
- Train high-quality text-to-image diffusion models in a data & compute efficient manner☆492Updated 3 weeks ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,708Updated 8 months ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆424Updated 4 months ago
- The Autograd Engine☆596Updated 7 months ago
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆536Updated this week
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆862Updated 2 months ago
- Official implementation of Inductive Moment Matching☆448Updated last month
- Training Large Language Model to Reason in a Continuous Latent Space☆1,062Updated 2 months ago
- The Tensor (or Array)☆429Updated 8 months ago
- Implementation of Diffusion Transformer (DiT) in JAX☆270Updated 10 months ago
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,267Updated 4 months ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,040Updated 2 months ago
- A PyTorch native library for large-scale model training☆3,607Updated this week
- The n-gram Language Model☆1,414Updated 8 months ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆763Updated 6 months ago