Alternatives and similar repositories for qat

Users that are interested in qat are comparing it to the libraries listed below

• Qualcomm-AI-research / transformer-quantization
  ☆206Updated 3 years ago
• Qualcomm-AI-research / FP8-quantization
  ☆161Updated 2 years ago
• xudoong / EdgeVisionTransformer
  To deploy Transformer models in CV to mobile devices.
  ☆18Updated 3 years ago
• masahi / torchscript-to-tvm
  ☆68Updated 2 years ago
• aojunzz / NM-sparsity
  ☆241Updated 2 years ago
• leimao / PyTorch-Quantization-Aware-Training
  PyTorch Quantization Aware Training Example
  ☆140Updated last year
• snap-research / F8Net
  [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
  ☆95Updated 3 years ago
• skmhrk1209 / QuanTorch
  PyTorch implementation of "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"
  ☆58Updated 6 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆158Updated 2 years ago
• piojanu / CUDA-im2col-conv
  CUDA project for uni subject
  ☆26Updated 4 years ago
• mit-han-lab / inter-operator-scheduler
  [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration
  ☆200Updated 3 years ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆54Updated 3 years ago
• itayhubara / CalibTIP
  Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
  ☆99Updated 4 years ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆94Updated 3 weeks ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆91Updated 2 years ago
• MegEngine / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆100Updated last year
• papers-submission / CalibTIP
  Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
  ☆36Updated 2 years ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆40Updated 7 months ago
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆111Updated 10 months ago
• tlc-pack / TLCBench
  Benchmark scripts for TVM
  ☆74Updated 3 years ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆101Updated 7 years ago
• lenLRX / AmpereSparseMatmul
  study of Ampere' Sparse Matmul
  ☆18Updated 4 years ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆116Updated last year
• A-suozhang / awesome-quantization-and-fixed-point-training
  Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design
  ☆160Updated 4 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated 2 years ago
• DeadAt0m / LSQFakeQuantize-PyTorch
  FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch
  ☆35Updated 3 years ago
• gilshm / sparq
  Post-training sparsity-aware quantization
  ☆34Updated 2 years ago
• BBuf / how-to-optimize-gemm
  ☆98Updated 4 years ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated 2 years ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆83Updated 2 years ago