DefTruth / Awesome-Diffusion-Inference
📖A curated list of Awesome Diffusion Inference Papers with codes, such as Sampling, Caching, Multi-GPUs, etc. 🎉🎉
☆168Updated this week
Alternatives and similar repositories for Awesome-Diffusion-Inference:
Users that are interested in Awesome-Diffusion-Inference are comparing it to the libraries listed below
- Model Compression Toolbox for Large Language Models and Diffusion Models☆299Updated 3 weeks ago
- ☆127Updated this week
- flash attention tutorial written in python, triton, cuda, cutlass☆244Updated 2 weeks ago
- A parallelism VAE avoids OOM for high resolution image generation☆49Updated last week
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆400Updated 2 weeks ago
- A collection of memory efficient attention operators implemented in the Triton language.☆229Updated 7 months ago
- [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models☆643Updated last month
- Context parallel attention that accelerates DiT model inference with dynamic caching☆147Updated this week
- A fast communication-overlapping library for tensor parallelism on GPUs.☆271Updated 2 months ago
- Materials for learning SGLang☆166Updated last week
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆205Updated 3 weeks ago
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.☆94Updated last month
- Dynamic Memory Management for Serving LLMs without PagedAttention☆272Updated last month
- [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference☆234Updated last month
- A sparse attention kernel supporting mix sparse patterns☆93Updated 3 months ago
- FlagGems is an operator library for large language models implemented in Triton Language.☆397Updated this week
- [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving☆290Updated 6 months ago
- mllm-npu: training multimodal large language models on Ascend NPUs☆90Updated 4 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆75Updated last week
- Puzzles for learning Triton, play it with minimal environment configuration!☆199Updated last month
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆373Updated 4 months ago
- Efficient LLM Inference over Long Sequences☆344Updated 2 weeks ago
- ☆52Updated last month
- QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving☆481Updated 2 months ago
- A Easy-to-understand TensorOp Matmul Tutorial☆306Updated 3 months ago
- A list of papers, docs, codes about efficient AIGC. This repo is aimed to provide the info for efficient AIGC research, including languag…☆166Updated 2 months ago
- xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism☆1,146Updated last week
- ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation☆40Updated 4 months ago
- High performance Transformer implementation in C++.☆98Updated this week
- Ring attention implementation with flash attention☆645Updated 3 weeks ago