[AAAI 2026] Official implementation of "FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models". If you find this repository helpful, please consider starring 🌟 it to support the project — it means a lot for us! Our paper is available here:
☆19Aug 26, 2026Updated 2 months ago
Alternatives and similar repositories for FlashSVD
Users that are interested in FlashSVD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACM MM 2026 Oral]⚡ZEUS accelerates your diffuser. Any modality. Any model. Any scheduler. https://yixiao-wang-stats.github.io/zeus/☆24Jun 2, 2026Updated 5 months ago
- This is Official implementation for T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasonin…☆25Mar 5, 2026Updated 8 months ago
- [ICLR 2025] Dobi-SVD : Differentiable SVD for LLM Compression and Some New Perspectives"☆54Oct 19, 2025Updated last year
- Training-free inference acceleration framework for interactive video world models, with tested support for HY-WorldPlay and Matrix-Game-3…☆23Jun 18, 2026Updated 5 months ago
- [NeurIPS'25] KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems☆18Nov 1, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Preview Code for MARS Paper☆12Nov 3, 2026Updated 2 weeks ago
- [ICML 2025] Official Repo for Stability-guided Adaptive Diffusion Acceleration. 🚀🌙Accelerating off-the-shelf diffusion model with a uni…☆44Jul 24, 2025Updated last year
- Accelerate FLUX.2 inference from 18s to 12s (33% speedup) using SADA in H200☆11Feb 3, 2026Updated 9 months ago
- PyTorch code for our paper "AdaSVD: Adaptive Singular Value Decomposition for Large Language Models"☆16Mar 9, 2025Updated last year
- "Knock, knock!" "Who's there?" "Dobi."☆17Aug 11, 2025Updated last year
- [DAC 2026] FlashFPS☆17Jun 1, 2026Updated 5 months ago
- [HPCA 2026] FractalCloud: A Fractal-Inspired Architecture for Efficient Large-Scale Point Cloud Processing☆22Apr 21, 2026Updated 6 months ago
- Code for paper "Why Do Transformers Fail to Forecast Time Series In-Context?"☆14Oct 15, 2025Updated last year
- [NeurIPS Spotlight 2025] Angles Don’t Lie: Unlocking Training-Efficient RL Through the Model’s Own Signals.☆83Sep 26, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This is the official Python version of CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Act…☆20Oct 25, 2024Updated 2 years ago
- This repository provides the official implementation of QSVD, a method for efficient low-rank approximation that unifies Query-Key-Value …☆31May 16, 2026Updated 6 months ago
- Official repository for paper Routing-Free Mixture-of-Experts.☆20Oct 31, 2026Updated 2 weeks ago
- This repository implements SADA: Stability-guided Adaptive Diffusion Acceleration for ForgeUI. Speeds up SD XL, Flux by 1.3-2.0 times wit…☆14Aug 2, 2025Updated last year
- JellyBean prototype☆10Sep 28, 2022Updated 4 years ago
- An RPG Maker MZ plugin☆13Nov 2, 2023Updated 3 years ago
- ☆12Jun 2, 2026Updated 5 months ago
- An efficient service for transparent GPU multiplexing with VRAM oversubscription, OSDI '26☆14Sep 24, 2026Updated last month
- ☆13Jan 17, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- (ICLR 2025) BinaryDM: Accurate Weight Binarization for Efficient Diffusion Models☆25Oct 4, 2024Updated 2 years ago
- The code of the paper "Depth-Synergized Mamba Meets Memory Experts for All-Day Image Reflection Separation" (AAAI 2026)☆11Apr 1, 2026Updated 7 months ago
- Calibration-free OrbitQuant for transformer backbones, with Hugging Face integration and packed CUDA/Metal inference☆15Nov 11, 2026Updated last week
- Autonomous GPU kernel optimization system driven by AI agents.☆32Mar 29, 2026Updated 7 months ago
- [NAACL' 25 main] Lillama: Large Language Model Compression via Low-Rank Feature Distillation☆11Apr 10, 2025Updated last year
- ☆12Nov 14, 2025Updated last year
- Learning Dynamic Collaborative Network for Semi-supervised 3D Vessel Segmentation☆17Dec 16, 2025Updated 11 months ago
- [AAAI26 Oral] When Trackers Date Fish: A Benchmark and Framework for Underwater Multiple Fish Tracking☆18Jul 30, 2026Updated 3 months ago
- 我的本科毕业论文☆16Aug 2, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A Serving System for Distributed and Parallel LLM Quantization [Efficient ML System]☆26Jun 18, 2025Updated last year
- Official code release for "TDFNet: An Efficient Audio-Visual Speech Separation Model with Top-down Fusion", accepted ICIST 2023☆15Mar 17, 2024Updated 2 years ago
- ☆12Feb 10, 2026Updated 9 months ago
- Official implementation of "DPad: Efficient Diffusion Language Models with Suffix Dropout"☆67Feb 13, 2026Updated 9 months ago
- Tiered optimizer state allocation for memory efficient MoE training. Cuts optimizer memory by 97.4%, outperforming AdamW/Muon/Lion while …☆14Sep 10, 2026Updated 2 months ago
- ☆14Apr 14, 2026Updated 7 months ago
- SGLang fork to reproduce the official Mirai Labs DFlash-TfM results☆24Oct 14, 2026Updated last month
Are these results useful?