xdit-project / xDiT
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
☆1,146Updated last week
Alternatives and similar repositories for xDiT:
Users that are interested in xDiT are comparing it to the libraries listed below
- Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossi…☆834Updated 3 weeks ago
- [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models☆643Updated last month
- SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models☆585Updated this week
- 📖A curated list of Awesome Diffusion Inference Papers with codes, such as Sampling, Caching, Multi-GPUs, etc. 🎉🎉☆168Updated this week
- Model Compression Toolbox for Large Language Models and Diffusion Models☆299Updated 3 weeks ago
- VideoSys: An easy and efficient system for video generation☆1,875Updated 2 weeks ago
- Infinity ∞ : Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis☆871Updated this week
- [CVPR 2024] DeepCache: Accelerating Diffusion Models for Free☆832Updated 6 months ago
- Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.☆1,213Updated last month
- FastVideo is a lightweight framework for accelerating large video diffusion models.☆859Updated this week
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆400Updated 2 weeks ago
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆602Updated 3 months ago
- A highly optimized LLM inference acceleration engine for Llama and its variants.☆712Updated this week
- [CVPR2024 Highlight] VBench - We Evaluate Video Generation☆695Updated this week
- Next-Token Prediction is All You Need☆1,965Updated 2 months ago
- Official repo of our paper "SDXS: Real-Time One-Step Latent Diffusion Models with Image Conditions"☆624Updated 7 months ago
- Memory-optimized training scripts for video models based on Diffusers☆730Updated this week
- Context parallel attention that accelerates DiT model inference with dynamic caching☆147Updated this week
- Ring attention implementation with flash attention☆645Updated 3 weeks ago
- Official Implementation of "Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraini…☆534Updated 5 months ago
- HART: Efficient Visual Generation with Hybrid Autoregressive Transformer☆405Updated 3 months ago
- An acceleration library that supports arbitrary bit-width combinatorial quantization operations☆241Updated 3 months ago
- Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement 🔥☆488Updated last week
- FlagGems is an operator library for large language models implemented in Triton Language.☆397Updated this week
- Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,129Updated 3 weeks ago
- Allegro is a powerful text-to-video model that generates high-quality videos up to 6 seconds at 15 FPS and 720p resolution from simple te…☆965Updated 2 weeks ago
- Identity-Preserving Text-to-Video Generation by Frequency Decomposition☆537Updated this week
- [ICCV 2023] Q-Diffusion: Quantizing Diffusion Models.☆341Updated 9 months ago
- ☆127Updated this week
- ☆435Updated this week