thu-ml / Jetfire-INT8Training

Related projects: ⓘ

• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆50Updated 6 months ago
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆38Updated 10 months ago
• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆89Updated last week
• mit-han-lab / lmquant
  ☆102Updated 3 months ago
• Guangxuan-Xiao / torch-int
  This repository contains integer operators on GPUs for PyTorch.
  ☆172Updated 11 months ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆46Updated last year
• facebookresearch / SpinQuant
  Code repo for the paper "SpinQuant LLM quantization with learned rotations"
  ☆79Updated this week
• LiuXiaoxuanPKU / GACT-ICML
  ☆39Updated last year
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆72Updated last month
• IST-DASLab / OBC
  Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".
  ☆95Updated last year
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆87Updated 3 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆113Updated last year
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆161Updated 2 months ago
• nbasyl / OFQ
  The official implementation of the ICML 2023 paper OFQ-ViT
  ☆27Updated 11 months ago
• iamkanghyunchoi / ait
  It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher [CVPR 2022 Oral]
  ☆30Updated 2 years ago
• Zhen-Dong / BitPack
  BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.
  ☆49Updated last year
• HandH1998 / QQQ
  QQQ is an innovative and hardware-optimized W4A8 quantization solution.
  ☆59Updated last week
• wimh966 / QDrop
  The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quan…
  ☆107Updated last year
• Qualcomm-AI-research / oscillations-qat
  ☆67Updated 2 years ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆35Updated last month
• hustvl / PD-Quant
  [CVPR 2023] PD-Quant: Post-Training Quantization Based on Prediction Difference Metric
  ☆49Updated last year
• thu-nics / ViDiT-Q
  ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
  ☆23Updated 3 weeks ago
• naver-aics / lut-gemm
  ☆33Updated 5 months ago
• htqin / BiBench
  [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…
  ☆54Updated 6 months ago
• cjf00000 / StatQuant
  code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"
  ☆26Updated 3 years ago
• Qualcomm-AI-research / transformer-quantization
  ☆186Updated 2 years ago
• Qualcomm-AI-research / pruning-vs-quantization
  ☆13Updated 6 months ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆47Updated last year
• DD-DuDa / awesome-vit-quantization-acceleration
  List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.
  ☆47Updated 3 months ago
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆98Updated 9 months ago