[USENIX ATC'25] GeneralSparse: Bridging the Gap in SpMM for Pruned Large Language Model Inference on GPUs
☆14Feb 4, 2026Updated 9 months ago
Alternatives and similar repositories for GeneralSparse
Users that are interested in GeneralSparse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Revitalizing Sparse Matrix-Matrix Multiplication on Tensor Cores with Asynchronous and Balanced Kernel Optimization☆14Jul 16, 2025Updated last year
- Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores (EuroSys'25)☆16Jul 17, 2025Updated last year
- A Row Decomposition-based Approach for Sparse Matrix Multiplication on GPUs☆30Nov 29, 2023Updated 2 years ago
- Mirror of http://gitlab.hpcrl.cse.ohio-state.edu/chong/ppopp19_ae, refactoring for understanding☆17Oct 20, 2021Updated 5 years ago
- Horizontal Fusion☆24Jan 7, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Papers relevant with graph and GPU☆12Jan 1, 2026Updated 10 months ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆70Mar 25, 2025Updated last year
- Official implementation of Acc-SpMM: Accelerating General-purpose Sparse Matrix-Matrix Multiplication with GPU Tensor Cores.☆38Nov 13, 2025Updated last year
- Repository for artifact evaluation of ASPLOS 2023 paper "SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning"☆25Feb 24, 2023Updated 3 years ago
- FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…☆41Oct 5, 2025Updated last year
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆63Nov 24, 2023Updated 2 years ago
- GPU TopK Benchmark☆18Dec 19, 2024Updated last year
- Artifact for PPoPP20 "Understanding and Bridging the Gaps in Current GNN Performance Optimizations"☆42Nov 16, 2021Updated 5 years ago
- ☆46Jun 19, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- performance engineering☆30Jul 11, 2024Updated 2 years ago
- Studying GPU Multi-tenancy☆11Jan 11, 2019Updated 7 years ago
- ☆15Jun 10, 2026Updated 5 months ago
- 方便扩展的Cuda算子理解和优化框架,仅用在学习使用☆18Jun 13, 2024Updated 2 years ago
- Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.☆13Nov 3, 2023Updated 3 years ago
- [ICLR 2025] Systematic Outliers in Large Language Models.☆11Feb 11, 2025Updated last year
- A High-Throughput Multi-GPU System for Graph-Based Approximate Nearest Neighbor Search☆21Jul 22, 2025Updated last year
- Source code of the SC '23 paper: "DASP: Specific Dense Matrix Multiply-Accumulate Units Accelerated General Sparse Matrix-Vector Multipli…☆29Jun 18, 2024Updated 2 years ago
- ☆12May 19, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆23Sep 14, 2026Updated 2 months ago
- ☆12Oct 5, 2026Updated last month
- codebase for Coruscant: Co-Designing GPU Kernel and Sparse Tensor Core to Advocate Unstructured Sparsity in Efficient LLM Inference☆11Oct 17, 2025Updated last year
- Latest PASTE (NSDI'18) repository☆13May 2, 2022Updated 4 years ago
- ☆40Jul 25, 2022Updated 4 years ago
- ☆27Apr 13, 2025Updated last year
- 关于AI,ML,DA,DV等的几个经典案例,包括堵车模拟(NagelSchreckenberg)、蒙特卡洛排队问题(Monte Carlo Queuing Problem)、人脸识别(RecognitionFace)、遗传算法推断图像(IconGenetic)☆10Oct 14, 2018Updated 8 years ago
- A intelligent matrix format designer for SpMV☆10Oct 10, 2023Updated 3 years ago
- 基于 mirai, Graia 的 QQ 机器人,可执行 Python, Mathematica, C++ 等代码,可以调用 Copilot 补全、Stable Diffusion (NovelAI) 文字转图片☆16Oct 14, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A collection of papers on awesome genome acceleration, e.g., architectures, systems, and algorithms.☆11Jun 9, 2026Updated 5 months ago
- [ICLR 2025] Probe Pruning: Accelerating LLMs through Dynamic Pruning via Model-Probing☆12May 11, 2026Updated 6 months ago
- Parallel SpMV using CSR representation, built in CUDA☆14Jun 27, 2020Updated 6 years ago
- An efficient breast-specific whole slide foundation model for precision oncology☆25Oct 22, 2026Updated 3 weeks ago
- ☆11Dec 29, 2024Updated last year
- 「賞金で二郎一生分食べたい!」チームのレポジトリです.☆11Dec 9, 2021Updated 4 years ago
- This is the official repo for "Differentiable Model Scaling using Differentiable Topk"☆12May 16, 2024Updated 2 years ago
Are these results useful?