mit-han-lab / patch_conv
Patch convolution to avoid large GPU memory usage of Conv2D
☆81Updated 7 months ago
Alternatives and similar repositories for patch_conv:
Users that are interested in patch_conv are comparing it to the libraries listed below
- ☆52Updated last week
- A parallelism VAE avoids OOM for high resolution image generation☆49Updated last week
- ☆127Updated this week
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆23Updated last month
- [NeurIPS 2024] Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching☆91Updated 6 months ago
- A sparse attention kernel supporting mix sparse patterns☆93Updated 3 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆75Updated this week
- The official implementation of PTQD: Accurate Post-Training Quantization for Diffusion Models☆94Updated 10 months ago
- [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…☆55Updated 7 months ago
- An algorithm for static activation quantization of LLMs☆107Updated this week
- PyTorch code for Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers☆36Updated 4 months ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated last year
- ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation☆40Updated 4 months ago
- [ECCV24] MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization☆32Updated last month
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆37Updated 5 months ago
- ☆157Updated last year
- Odysseus: Playground of LLM Sequence Parallelism☆64Updated 7 months ago
- Adaptive Caching for Faster Video Generation with Diffusion Transformers☆134Updated 2 months ago
- Model Compression Toolbox for Large Language Models and Diffusion Models☆299Updated 3 weeks ago
- ☆30Updated 5 months ago
- Quantized Attention on GPU☆34Updated last month
- Accelerating Diffusion Transformers with Token-wise Feature Caching☆46Updated last week
- pytorch-profiler☆50Updated last year
- Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆76Updated last month
- Implementation of Post-training Quantization on Diffusion Models (CVPR 2023)☆127Updated last year
- FORA introduces simple yet effective caching mechanism in Diffusion Transformer Architecture for faster inference sampling.☆33Updated 6 months ago
- Memory Efficient Training Framework for Large Video Generation Model☆24Updated 8 months ago
- ☆55Updated 3 months ago
- Official implementation of the ICLR 2024 paper AffineQuant☆23Updated 9 months ago