FORA introduces simple yet effective caching mechanism in Diffusion Transformer Architecture for faster inference sampling.
☆56Jul 8, 2024Updated 2 years ago
Alternatives and similar repositories for FORA
Users that are interested in FORA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆192Jan 14, 2025Updated last year
- [NeurIPS 2024] Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching☆122Jul 15, 2024Updated 2 years ago
- [ICLR2025] Accelerating Diffusion Transformers with Token-wise Feature Caching☆220Mar 14, 2025Updated last year
- Official PyTorch code for ICLR 2025 paper "Gnothi Seauton: Empowering Faithful Self-Interpretability in Black-Box Models"☆23Mar 4, 2025Updated last year
- 📚 Collection of awesome generation acceleration resources.☆402Jul 7, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆49Mar 3, 2024Updated 2 years ago
- [ICCV2025] From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers☆406Mar 2, 2026Updated 4 months ago
- Communication-Efficient Diffusion Denoising Parallelization via Reuse-then-Predict Mechanism (NIPS'25)☆16Oct 6, 2025Updated 9 months ago
- [ICLR 2025] FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality☆263Dec 27, 2024Updated last year
- Code for our ICCV 2025 paper "Adaptive Caching for Faster Video Generation with Diffusion Transformers"☆172Nov 5, 2024Updated last year
- The officalimplement of dLLM-Factory☆25Jul 12, 2025Updated last year
- Official implementation of our paper: "Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharing" …☆83May 22, 2025Updated last year
- [NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising☆215Sep 27, 2025Updated 9 months ago
- (ToCa-v2) A New version of ToCa，with faster speed and better acceleration!☆42Mar 13, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Implementation of SmoothCache, a project aimed at speeding-up Diffusion Transformer (DiT) based GenAI models with error-guided caching.☆48Jul 17, 2025Updated last year
- Data distillation benchmark☆73Jun 13, 2025Updated last year
- T-GATE: Temporally Gating Attention to Accelerate Diffusion Model for Free!☆418Feb 26, 2025Updated last year
- (ICLR 2026 🔥) Code for "The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMs"☆79Feb 9, 2026Updated 5 months ago
- FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]☆52Apr 29, 2026Updated 2 months ago
- [NeurIPS 2025] Reward-Instruct: A Reward-Centric Approach to Fast Photo-Realistic Image Generation☆35Oct 24, 2025Updated 8 months ago
- Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model☆1,357Jun 8, 2025Updated last year
- VideoSys: An easy and efficient system for video generation☆2,026Aug 27, 2025Updated 10 months ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Aug 29, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [TPAMI 26/ NeurIPS 24] Official PyTorch Implementation of "FlowTurbo: Towards Real-time Flow-Based Image Generation with Velocity Refiner…☆75Oct 21, 2025Updated 9 months ago
- 📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉☆578Jun 13, 2026Updated last month
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆211May 1, 2026Updated 2 months ago
- Aiming to integrate most existing feature caching-based diffusion acceleration schemes into a unified framework.☆110Oct 23, 2025Updated 8 months ago
- [NeurIPS 2024] Token Merging for Training-Free Semantic Binding in Text-to-Image Synthesis☆86Feb 3, 2025Updated last year
- [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"☆11Jul 19, 2024Updated 2 years ago
- Autonomous GPU kernel optimization system driven by AI agents.☆31Mar 29, 2026Updated 3 months ago
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆78Dec 3, 2024Updated last year
- Scaling Diffusion Transformers with Mixture of Experts☆434Sep 9, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [CVPR 2024] DeepCache: Accelerating Diffusion Models for Free☆970Jun 27, 2024Updated 2 years ago
- ☆20Dec 24, 2025Updated 6 months ago
- Implementation of "RaanA: A Fast, Flexible, and Data-Efficient Post-Training Quantization Algorithm"☆17Apr 11, 2025Updated last year
- The official repo of continuous speculative decoding☆36Mar 28, 2025Updated last year
- (ICCV2025) EEdit⚡: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editing☆62Sep 17, 2025Updated 10 months ago
- This is the official implementation for the paper: Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models☆19Sep 11, 2024Updated last year
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆34Nov 29, 2024Updated last year