kpu / intgemm
int8_t and int16_t matrix multiply based on https://arxiv.org/abs/1705.01991
☆63Updated 8 months ago
Related projects: ⓘ
- Fast stand-alone C++ decoder for RNN-based NMT models☆25Updated 3 years ago
- Fast matrix multiplication for few-bit integer matrices on CPUs.☆27Updated 5 years ago
- Customized matrix multiplication kernels☆53Updated 2 years ago
- Clover: Quantized 4-bit Linear Algebra Library☆110Updated 6 years ago
- Fast sparse deep learning on CPUs☆51Updated last year
- Fast integer division with divisor not known at compile time. To be used primarily in CUDA kernels.☆70Updated 8 years ago
- Codebase associated with the PyTorch compiler tutorial☆44Updated 5 years ago
- nGraph™ Backend for ONNX☆42Updated last year
- MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.☆123Updated 11 months ago
- DLPack for Tensorflow☆36Updated 4 years ago
- THIS REPOSITORY HAS MOVED TO github.com/nvidia/cub, WHICH IS AUTOMATICALLY MIRRORED HERE.☆81Updated 6 months ago
- CUDA templates for tile-sparse matrix multiplication based on CUTLASS.☆48Updated 6 years ago
- PyProf2: PyTorch Profiling tool☆83Updated 4 years ago
- Library for fast image convolution in neural networks on Intel Architecture☆29Updated 7 years ago
- ☆297Updated 2 months ago
- ☆66Updated last year
- ☆26Updated last year
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 3 years ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆52Updated 6 years ago
- ☆48Updated 6 months ago
- Conversion to/from half-precision floating point formats☆324Updated last month
- A portable high-level API with CUDA or OpenCL back-end☆53Updated 6 years ago
- ☆16Updated this week
- Training neural networks in TensorFlow 2.0 with 5x less memory☆127Updated 2 years ago
- Stretching GPU performance for GEMMs and tensor contractions.☆213Updated this week
- Applications using the GTN library and code to reproduce experiments in "Differentiable Weighted Finite-State Transducers"☆80Updated 2 years ago
- An Open Convolutional Neural Network Framework in C++ From Scratch☆57Updated 3 years ago
- flexible-gemm conv of deepcore☆17Updated 4 years ago
- Tensors and Dynamic neural networks in Python with strong GPU acceleration☆26Updated last year
- Test winograd convolution written in TVM for CUDA and AMDGPU☆39Updated 5 years ago