marsupialtail / sparsednnLinks
Fast sparse deep learning on CPUs
☆56Updated 3 years ago
Alternatives and similar repositories for sparsednn
Users that are interested in sparsednn are comparing it to the libraries listed below
Sorting:
- Research and development for optimizing transformers☆131Updated 4 years ago
- ☆159Updated 2 years ago
- ☆68Updated 2 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆137Updated 3 years ago
- GEMM and Winograd based convolutions using CUTLASS☆28Updated 5 years ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆123Updated last year
- CUDA templates for tile-sparse matrix multiplication based on CUTLASS.☆50Updated 7 years ago
- System for automated integration of deep learning backends.☆47Updated 3 years ago
- ☆50Updated last year
- Customized matrix multiplication kernels☆57Updated 3 years ago
- A library of GPU kernels for sparse matrix operations.☆277Updated 5 years ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆140Updated 2 years ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆102Updated 7 years ago
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆112Updated last year
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆200Updated 3 years ago
- llama INT4 cuda inference with AWQ☆55Updated 10 months ago
- Benchmark scripts for TVM☆74Updated 3 years ago
- ☆145Updated 10 months ago
- ☆71Updated 8 months ago
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆122Updated 3 years ago
- ☆167Updated 2 years ago
- Benchmarks to capture important workloads.☆31Updated 10 months ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 4 years ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆122Updated last year
- ParaDnn: A systematic performance analysis methodology for deep learning.☆40Updated 5 years ago
- PyTorch RFCs (experimental)☆136Updated 6 months ago
- Ahead of Time (AOT) Triton Math Library☆84Updated 3 weeks ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆272Updated 4 months ago
- ☆96Updated last year
- ☆41Updated 3 years ago