Alternatives and similar repositories for qat

Users that are interested in qat are comparing it to the libraries listed below

• itayhubara / CalibTIP
  Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
  ☆97Updated 3 years ago
• leimao / PyTorch-Quantization-Aware-Training
  PyTorch Quantization Aware Training Example
  ☆136Updated last year
• snap-research / F8Net
  [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
  ☆95Updated 3 years ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆92Updated last week
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated 2 years ago
• MegEngine / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆100Updated last year
• skmhrk1209 / QuanTorch
  PyTorch implementation of "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"
  ☆55Updated 5 years ago
• Qualcomm-AI-research / transformer-quantization
  ☆204Updated 3 years ago
• Qualcomm-AI-research / FP8-quantization
  ☆149Updated 2 years ago
• aojunzz / NM-sparsity
  ☆232Updated 2 years ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆81Updated 2 years ago
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆110Updated 6 months ago
• peiswang / BitSplit
  BitSplit Post-trining Quantization
  ☆50Updated 3 years ago
• DeadAt0m / LSQFakeQuantize-PyTorch
  FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch
  ☆34Updated 3 years ago
• papers-submission / CalibTIP
  Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
  ☆35Updated last year
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆91Updated last year
• masahi / torchscript-to-tvm
  ☆69Updated 2 years ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆37Updated 3 months ago
• A-suozhang / awesome-quantization-and-fixed-point-training
  Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design
  ☆161Updated 4 years ago
• mrusci / training-mixed-precision-quantized-networks
  This repository containts the pytorch scripts to train mixed-precision networks for microcontroller deployment, based on the memory contr…
  ☆49Updated last year
• tlc-pack / TLCBench
  Benchmark scripts for TVM
  ☆74Updated 3 years ago
• zhutmost / neuralzip
  A Out-of-box PyTorch Scaffold for Neural Network Quantization-Aware-Training (QAT) Research. Website: https://github.com/zhutmost/neuralz…
  ☆26Updated 2 years ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 5 years ago
• xudoong / EdgeVisionTransformer
  To deploy Transformer models in CV to mobile devices.
  ☆18Updated 3 years ago
• UDC-GAC / openCNN
  A Winograd Minimal Filter Implementation in CUDA
  ☆24Updated 3 years ago
• marsupialtail / gpu-sparsert
  ☆18Updated 4 years ago
• BBuf / how-to-optimize-gemm
  ☆96Updated 3 years ago
• lswzjuer / pytorch-quantity
  An 8bit automated quantization conversion tool for the pytorch (Post-training quantization based on KL divergence)
  ☆33Updated 5 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆110Updated 8 months ago
• uwsampl / SparseTIR
  SparseTIR: Sparse Tensor Compiler for Deep Learning
  ☆138Updated 2 years ago