A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
☆63Nov 24, 2023Updated 2 years ago
Alternatives and similar repositories for venom
Users that are interested in venom are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Efficient N:M sparsity implementation for GPGPU☆10Oct 31, 2024Updated 2 years ago
- ☆46Jun 19, 2024Updated 2 years ago
- Code for High Performance Unstructured SpMM Computation Using Tensor Cores☆36Nov 3, 2024Updated 2 years ago
- ☆14Dec 12, 2024Updated last year
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆70Mar 25, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official implementation of Acc-SpMM: Accelerating General-purpose Sparse Matrix-Matrix Multiplication with GPU Tensor Cores.☆38Nov 13, 2025Updated last year
- ☆166Jul 22, 2024Updated 2 years ago
- Revitalizing Sparse Matrix-Matrix Multiplication on Tensor Cores with Asynchronous and Balanced Kernel Optimization☆14Jul 16, 2025Updated last year
- ☆32Aug 24, 2022Updated 4 years ago
- [USENIX ATC'25] GeneralSparse: Bridging the Gap in SpMM for Pruned Large Language Model Inference on GPUs☆14Feb 4, 2026Updated 9 months ago
- FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…☆41Oct 5, 2025Updated last year
- Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores (EuroSys'25)☆16Jul 17, 2025Updated last year
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆91Nov 23, 2022Updated 3 years ago
- Source code for paper Fused3S: Fast Sparse Attention on Tensor Cores☆11Oct 13, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Pytorch implementation of our paper accepted by ICML 2023 -- "Bi-directional Masks for Efficient N:M Sparse Training"☆14Jun 7, 2023Updated 3 years ago
- A library of GPU kernels for sparse matrix operations.☆289Nov 24, 2020Updated 5 years ago
- Artifact for USENIX ATC'23: TC-GNN: Bridging Sparse GNN Computation and Dense Tensor Cores on GPUs.☆58Oct 16, 2023Updated 3 years ago
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆246Sep 24, 2023Updated 3 years ago
- Source code of the SC '23 paper: "DASP: Specific Dense Matrix Multiply-Accumulate Units Accelerated General Sparse Matrix-Vector Multipli…☆29Jun 18, 2024Updated 2 years ago
- Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.☆13Nov 3, 2023Updated 3 years ago
- A Row Decomposition-based Approach for Sparse Matrix Multiplication on GPUs☆30Nov 29, 2023Updated 2 years ago
- A GPU algorithm for sparse matrix-matrix multiplication☆74Oct 1, 2020Updated 6 years ago
- ☆245Nov 9, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆10Apr 24, 2023Updated 3 years ago
- [Mlsys'22] Understanding gnn computational graph: A coordinated computation, io, and memory perspective☆22Sep 11, 2023Updated 3 years ago
- ☆35Apr 2, 2025Updated last year
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆145Mar 31, 2023Updated 3 years ago
- Accelerator RTL inspired by VEGETA [HPCA'23] and MicroScopiQ [ISCA'25]☆17Nov 11, 2025Updated last year
- ☆84Dec 2, 2022Updated 3 years ago
- codebase for Coruscant: Co-Designing GPU Kernel and Sparse Tensor Core to Advocate Unstructured Sparsity in Efficient LLM Inference☆11Oct 17, 2025Updated last year
- Source code of the IPDPS '21 paper: "TileSpMV: A Tiled Algorithm for Sparse Matrix-Vector Multiplication on GPUs" by Yuyao Niu, Zhengyang…☆13Aug 12, 2022Updated 4 years ago
- Mirror of http://gitlab.hpcrl.cse.ohio-state.edu/chong/ppopp19_ae, refactoring for understanding☆17Oct 20, 2021Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 7 months ago
- ☆14Sep 27, 2021Updated 5 years ago
- Benchmark for matrix multiplications between dense and block sparse (BSR) matrix in TVM, blocksparse (Gray et al.) and cuSparse.☆23Aug 21, 2020Updated 6 years ago
- CUDA project for uni subject☆26Oct 26, 2020Updated 6 years ago
- ☆20Sep 28, 2024Updated 2 years ago
- Source code repository for ASPLOS '25 paper "Syno: Structured Synthesis for Neural Operators"☆15Aug 31, 2025Updated last year
- ☆11Oct 9, 2023Updated 3 years ago
Are these results useful?