marsupialtail / sparsednnLinks
Fast sparse deep learning on CPUs
☆54Updated 2 years ago
Alternatives and similar repositories for sparsednn
Users that are interested in sparsednn are comparing it to the libraries listed below
Sorting:
- ☆159Updated last year
- Training neural networks in TensorFlow 2.0 with 5x less memory☆132Updated 3 years ago
- Research and development for optimizing transformers☆129Updated 4 years ago
- A library of GPU kernels for sparse matrix operations.☆271Updated 4 years ago
- ☆69Updated 2 years ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆113Updated last year
- ☆144Updated 6 months ago
- CUDA templates for tile-sparse matrix multiplication based on CUTLASS.☆51Updated 7 years ago
- Customized matrix multiplication kernels☆56Updated 3 years ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆98Updated 7 years ago
- GEMM and Winograd based convolutions using CUTLASS☆26Updated 5 years ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆137Updated 2 years ago
- System for automated integration of deep learning backends.☆47Updated 3 years ago
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆201Updated 3 years ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆261Updated last month
- ☆50Updated last year
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆122Updated 3 years ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆120Updated 9 months ago
- ☆229Updated last year
- Home for OctoML PyTorch Profiler☆113Updated 2 years ago
- Training material for IPU users: tutorials, feature examples, simple applications☆86Updated 2 years ago
- An open-source efficient deep learning framework/compiler, written in python.☆718Updated last month
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆110Updated 8 months ago
- llama INT4 cuda inference with AWQ☆54Updated 7 months ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆40Updated 6 months ago
- Ahead of Time (AOT) Triton Math Library☆75Updated this week
- extensible collectives library in triton☆88Updated 4 months ago
- oneCCL Bindings for Pytorch*☆100Updated 3 weeks ago
- Benchmark scripts for TVM☆75Updated 3 years ago
- ☆208Updated 9 months ago