Qualcomm-AI-research / dynamic-sparsityLinks
☆12Updated 5 months ago
Alternatives and similar repositories for dynamic-sparsity
Users that are interested in dynamic-sparsity are comparing it to the libraries listed below
Sorting:
- ☆10Updated 11 months ago
- Sparsity support for PyTorch☆36Updated 5 months ago
- ☆15Updated last year
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆57Updated 5 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆95Updated 2 months ago
- Artifacts of EVT ASPLOS'24☆26Updated last year
- ☆23Updated 2 weeks ago
- Test suite for probing the numerical behavior of NVIDIA tensor cores☆41Updated last year
- Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs☆27Updated last year
- Modified version of PyTorch able to work with changes to GPGPU-Sim☆56Updated 2 years ago
- ☆40Updated last year
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆33Updated last year
- ☆12Updated 4 years ago
- The official implementation of the DAC 2024 paper GQA-LUT☆20Updated 8 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆81Updated this week
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆31Updated 6 months ago
- ☆32Updated 2 weeks ago
- ☆150Updated last year
- ☆81Updated 7 months ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆138Updated 2 years ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆47Updated 3 weeks ago
- TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators☆77Updated 2 months ago
- ☆27Updated last year
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆53Updated last year
- LLM Inference with Microscaling Format☆29Updated 9 months ago
- Torch2Chip (MLSys, 2024)☆53Updated 5 months ago
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆12Updated 5 months ago
- Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs☆23Updated 8 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆53Updated last year
- Research and development for optimizing transformers☆129Updated 4 years ago