chengzeyi / ParaAttention
Context parallel attention that accelerates DiT model inference with dynamic caching
☆165Updated this week
Alternatives and similar repositories for ParaAttention:
Users that are interested in ParaAttention are comparing it to the libraries listed below
- [NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising☆176Updated 4 months ago
- [ICLR 2025] FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality☆190Updated last month
- faster parallel inference of mochi-1 video generation model☆108Updated last month
- [ICLR2025] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models☆612Updated last week
- A parallelism VAE avoids OOM for high resolution image generation☆50Updated last week
- Official PyTorch implementation of paper "CLEAR: Conv-Like Linearization Revs Pre-Trained Diffusion Transformers Up".☆188Updated 3 weeks ago
- Adaptive Caching for Faster Video Generation with Diffusion Transformers☆139Updated 2 months ago
- Enhance-A-Video: Better Generated Video for Free☆264Updated last month
- Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model☆327Updated this week
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆17Updated 2 months ago
- End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8 training).☆312Updated 3 weeks ago
- ☆131Updated 2 weeks ago
- Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x fast…☆235Updated 3 months ago
- ☆48Updated 10 months ago
- Model Compression Toolbox for Large Language Models and Diffusion Models☆309Updated last month
- ☆125Updated last month
- Accelerates Flux.1 image generation, just by using this node.☆120Updated last month
- ☆241Updated last month
- Official PyTorch and Diffusers Implementation of "LinFusion: 1 GPU, 1 Minute, 16K Image"☆281Updated last month
- [ECCV24] MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization☆33Updated 2 months ago
- [NeurIPS 2024] Boosting the performance of consistency models with PCM!☆426Updated last month
- HART: Efficient Visual Generation with Hybrid Autoregressive Transformer☆411Updated 3 months ago
- Video-Infinity generates long videos quickly using multiple GPUs without extra training.☆169Updated 5 months ago
- ☆93Updated 7 months ago
- [NeurIPS 2024] Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching☆92Updated 6 months ago
- Faster generation with text-to-image diffusion models.☆208Updated 3 months ago
- Official Repository of the paper "Trajectory Consistency Distillation"☆324Updated 9 months ago
- ☆114Updated this week
- The code of our work "Golden Noise for Diffusion Models: A Learning Framework".☆81Updated last month
- 📖A curated list of Awesome Diffusion Inference Papers with codes, such as Sampling, Caching, Multi-GPUs, etc. 🎉🎉☆176Updated 2 weeks ago