Alternatives and similar repositories for qat

Users that are interested in qat are comparing it to the libraries listed below

• itayhubara / CalibTIP
  Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
  ☆99Updated 4 years ago
• Qualcomm-AI-research / transformer-quantization
  ☆205Updated 3 years ago
• aojunzz / NM-sparsity
  ☆237Updated 2 years ago
• masahi / torchscript-to-tvm
  ☆69Updated 2 years ago
• leimao / PyTorch-Quantization-Aware-Training
  PyTorch Quantization Aware Training Example
  ☆138Updated last year
• Qualcomm-AI-research / FP8-quantization
  ☆154Updated 2 years ago
• MegEngine / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆100Updated last year
• snap-research / F8Net
  [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
  ☆95Updated 3 years ago
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆110Updated 8 months ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆54Updated 3 years ago
• skmhrk1209 / QuanTorch
  PyTorch implementation of "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"
  ☆57Updated 5 years ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆94Updated this week
• mit-han-lab / inter-operator-scheduler
  [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration
  ☆200Updated 3 years ago
• papers-submission / CalibTIP
  Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
  ☆36Updated 2 years ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆91Updated 2 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆158Updated last year
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆96Updated 7 years ago
• A-suozhang / awesome-quantization-and-fixed-point-training
  Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design
  ☆161Updated 4 years ago
• marsupialtail / gpu-sparsert
  ☆18Updated 4 years ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆113Updated last year
• mrusci / training-mixed-precision-quantized-networks
  This repository containts the pytorch scripts to train mixed-precision networks for microcontroller deployment, based on the memory contr…
  ☆50Updated last year
• zhutmost / neuralzip
  A Out-of-box PyTorch Scaffold for Neural Network Quantization-Aware-Training (QAT) Research. Website: https://github.com/zhutmost/neuralz…
  ☆26Updated 2 years ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆54Updated 6 months ago
• peiswang / BitSplit
  BitSplit Post-trining Quantization
  ☆50Updated 3 years ago
• xuqiantong / CUDA-Winograd
  Fast CUDA Kernels for ResNet Inference.
  ☆177Updated 6 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated 2 years ago
• lixiuhong / batched_gemm
  ☆39Updated 5 years ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆39Updated 5 months ago
• tlc-pack / TLCBench
  Benchmark scripts for TVM
  ☆75Updated 3 years ago
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 10 months ago