kpu / intgemm
int8_t and int16_t matrix multiply based on https://arxiv.org/abs/1705.01991
☆67Updated last year
Alternatives and similar repositories for intgemm:
Users that are interested in intgemm are comparing it to the libraries listed below
- Fast stand-alone C++ decoder for RNN-based NMT models☆25Updated 4 years ago
- Fast Neural Machine Translation in C++ - development repository☆261Updated 4 months ago
- Fast matrix multiplication for few-bit integer matrices on CPUs.☆27Updated 5 years ago
- how to design cpu gemm on x86 with avx256, that can beat openblas.☆67Updated 5 years ago
- C99/C++ header-only library for division via fixed-point multiplication by inverse☆49Updated 10 months ago
- Fast sparse deep learning on CPUs☆52Updated 2 years ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 3 years ago
- Kernel Fusion and Runtime Compilation Based on NNVM☆70Updated 8 years ago
- Clover: Quantized 4-bit Linear Algebra Library☆112Updated 6 years ago
- Fast integer division with divisor not known at compile time. To be used primarily in CUDA kernels.☆71Updated 9 years ago
- ☆69Updated last year
- Codebase associated with the PyTorch compiler tutorial☆44Updated 5 years ago
- Customized matrix multiplication kernels☆53Updated 2 years ago
- A library of GPU kernels for sparse matrix operations.☆257Updated 4 years ago
- nGraph™ Backend for ONNX☆42Updated 2 years ago
- PyProf2: PyTorch Profiling tool☆82Updated 4 years ago
- This repository contains the results and code for the MLPerf™ Training v1.0 benchmark.☆38Updated 11 months ago
- Quantize weights and activations in Recurrent Neural Networks.☆94Updated 6 years ago
- ☆308Updated 2 months ago
- Library for fast image convolution in neural networks on Intel Architecture☆29Updated 7 years ago
- MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.☆127Updated last year
- Stretching GPU performance for GEMMs and tensor contractions.☆233Updated this week
- Test winograd convolution written in TVM for CUDA and AMDGPU☆40Updated 6 years ago
- ☆71Updated 3 months ago
- Conversion to/from half-precision floating point formats☆341Updated 6 months ago
- GEMM and Winograd based convolutions using CUTLASS☆26Updated 4 years ago
- Convert nvprof profiles into about:tracing compatible JSON files☆68Updated 3 years ago
- Python bindings for NVTX☆66Updated last year
- Personal collection of references for high performance mixed precision training.☆41Updated 5 years ago
- A portable high-level API with CUDA or OpenCL back-end☆54Updated 7 years ago