πA curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.π
β578Jun 13, 2026Updated last month
Alternatives and similar repositories for Awesome-DiT-Inference
Users that are interested in Awesome-DiT-Inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.β1,234Updated this week
- πA curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.πβ5,404Jun 23, 2026Updated 3 weeks ago
- [ICCV2025] From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeersβ406Mar 2, 2026Updated 4 months ago
- xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelismβ2,659Jul 14, 2026Updated last week
- https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic cachingβ427Jul 5, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- π Collection of awesome generation acceleration resources.β401Jul 7, 2025Updated last year
- A curated list of research papers, resources, and advancements on Diffusion Cache and related efficient diffusion model acceleration techβ¦β86Nov 4, 2025Updated 8 months ago
- A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and cachβ¦β61Oct 27, 2025Updated 8 months ago
- [ICML2025, NeurIPS2025 Spotlight] Sparse VideoGen 1 & 2: Accelerating Video Diffusion Transformers with Sparse Attentionβ692Jul 4, 2026Updated 2 weeks ago
- High performance inference engine for diffusion modelsβ107Sep 5, 2025Updated 10 months ago
- πLeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginnersπ, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.πβ11,578Updated this week
- A unified inference and post-training framework for accelerated video generation.β3,862Updated this week
- [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.β1,017Feb 25, 2026Updated 4 months ago
- [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationβ163Mar 21, 2025Updated last year
- Proton VPN Special Offer - Get 70% off β’ AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Distributed Compiler based on Triton for Parallel Systemsβ1,494Updated this week
- FlashInfer: Kernel Library for LLM Servingβ5,988Updated this week
- [ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-tβ¦β3,493Jan 17, 2026Updated 6 months ago
- β192Jan 14, 2025Updated last year
- Aiming to integrate most existing feature caching-based diffusion acceleration schemes into a unified framework.β109Oct 23, 2025Updated 8 months ago
- [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Modelsβ726Dec 2, 2024Updated last year
- A curated list of recent efficient video generation methods.β72Oct 7, 2025Updated 9 months ago
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Trainingβ883Updated this week
- (WIP) Parallel inference for black-forest-labs' FLUX model.β19Nov 18, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICLR2025] Accelerating Diffusion Transformers with Token-wise Feature Cachingβ221Mar 14, 2025Updated last year
- β64May 19, 2025Updated last year
- [NeurIPS 2025] Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generationβ603Nov 11, 2025Updated 8 months ago
- [ICLR 2026] Official implementation of DiCache: Let Diffusion Model Determine Its Own Cacheβ61Jan 26, 2026Updated 5 months ago
- π€FFPA: Extends FA-2/3 via Split-D for large headdims, 1.5x~6Γβπ vs SDPA, up to 513~535 TFLOPSπ on NVIDIA H200.β315Updated this week
- Lightweight Image Video Action Generation Inference Frameworkβ2,510Updated this week
- Code for our ICCV 2025 paper "Adaptive Caching for Faster Video Generation with Diffusion Transformers"β172Nov 5, 2024Updated last year
- Qwen-Image's DiT inference with TensorRT-10β21Oct 13, 2025Updated 9 months ago
- [ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Modelsβ3,912Mar 7, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits β’ AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [NeurIPS 2025] Training-Free Efficient Video Generation via Dynamic Token Carvingβ287Aug 4, 2025Updated 11 months ago
- [ATC'25] Katz is a high-performance serving system designed specifically for diffusion model workflows with multiple adapters.β24May 26, 2025Updated last year
- FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]β52Apr 29, 2026Updated 2 months ago
- A parallelism VAE avoids OOM for high resolution image generationβ95May 8, 2026Updated 2 months ago
- how to optimize some algorithm in cuda.β3,142Updated this week
- A Quirky Assortment of CuTe Kernelsβ1,063Updated this week
- A lightweight design for computation-communication overlap.β242Jan 20, 2026Updated 6 months ago