chengzeyi / ParaAttention
Context parallel attention that accelerates DiT model inference with dynamic caching
☆214Updated this week
Alternatives and similar repositories for ParaAttention:
Users that are interested in ParaAttention are comparing it to the libraries listed below
- [NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising☆188Updated 3 weeks ago
- [ICLR 2025] FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality☆198Updated 2 months ago
- Model Compression Toolbox for Large Language Models and Diffusion Models☆379Updated 3 weeks ago
- Accelerating Diffusion Transformers with Token-wise Feature Caching☆109Updated this week
- End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8 training).☆333Updated last month
- ☆150Updated 2 months ago
- faster parallel inference of mochi-1 video generation model☆112Updated 3 weeks ago
- Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model☆537Updated this week
- Official PyTorch implementation of paper "CLEAR: Conv-Like Linearization Revs Pre-Trained Diffusion Transformers Up".☆199Updated last month
- Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x fast…☆254Updated 5 months ago
- [ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models☆1,000Updated this week
- Adaptive Caching for Faster Video Generation with Diffusion Transformers☆142Updated 4 months ago
- A parallelism VAE avoids OOM for high resolution image generation☆56Updated last month
- 📖A curated list of Awesome Diffusion Inference Papers with codes: Sampling, Caching, Multi-GPUs, etc. 🎉🎉☆198Updated 2 months ago
- [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models☆664Updated 3 months ago
- Accelerates Flux.1 image generation, just by using this node.☆126Updated 3 months ago
- [NeurIPS 2024] Boosting the performance of consistency models with PCM!☆446Updated 3 months ago
- Enhance-A-Video: Better Generated Video for Free☆463Updated last week
- IP Adapter Instruct☆202Updated 7 months ago
- Faster generation with text-to-image diffusion models.☆211Updated 5 months ago
- ☆270Updated 2 months ago
- Official PyTorch and Diffusers Implementation of "LinFusion: 1 GPU, 1 Minute, 16K Image"☆294Updated 2 months ago
- HART: Efficient Visual Generation with Hybrid Autoregressive Transformer☆422Updated 5 months ago
- Official code for VMix: Improving Text-to-Image Diffusion Model with Cross-Attention Mixing Control☆182Updated 2 months ago
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆18Updated 4 months ago
- T-GATE: Temporally Gating Attention to Accelerate Diffusion Model for Free!☆382Updated 3 weeks ago
- [ICLR 2025] Official Implementation of Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image…☆291Updated this week