SonyResearch / micro_diffusion
Official repository for our work on micro-budget training of large-scale diffusion models.
☆1,231Updated last month
Alternatives and similar repositories for micro_diffusion:
Users that are interested in micro_diffusion are comparing it to the libraries listed below
- UNet diffusion model in pure CUDA☆597Updated 7 months ago
- NanoGPT (124M) in 3 minutes☆2,268Updated this week
- Schedule-Free Optimization in PyTorch☆2,095Updated 2 months ago
- nanoGPT style version of Llama 3.1☆1,311Updated 6 months ago
- PyTorch native quantization and sparsity for training and inference☆1,832Updated this week
- Code for BLT research paper☆1,387Updated this week
- A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes…☆1,957Updated last month
- 4M: Massively Multimodal Masked Modeling☆1,682Updated 4 months ago
- The Tensor (or Array)☆423Updated 6 months ago
- The Multilayer Perceptron Language Model☆537Updated 6 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆717Updated this week
- Implementation of Diffusion Transformer (DiT) in JAX☆264Updated 8 months ago
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆478Updated 7 months ago
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆840Updated 3 weeks ago
- The Autograd Engine☆566Updated 5 months ago
- Training Large Language Model to Reason in a Continuous Latent Space☆829Updated 3 weeks ago
- Tile primitives for speedy kernels☆2,026Updated this week
- Train high-quality text-to-image diffusion models in a data & compute efficient manner☆475Updated this week
- (WIP) A small but powerful, homemade PyTorch from scratch.☆521Updated this week
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆770Updated 3 weeks ago
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆1,923Updated 6 months ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,561Updated 6 months ago
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,177Updated 2 months ago
- Helpful tools and examples for working with flex-attention☆630Updated this week
- A PyTorch native library for large model training☆3,286Updated this week
- [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters☆495Updated this week
- Puzzles for learning Triton☆1,388Updated 2 months ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆930Updated 2 weeks ago
- A suite of image and video neural tokenizers☆1,553Updated this week
- 🚀 Efficient implementations of state-of-the-art linear attention models in Torch and Triton☆1,894Updated this week