Alternatives and similar repositories for Quark

Users that are interested in Quark are comparing it to the libraries listed below

• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆340Updated 7 months ago
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆749Updated 6 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆170Updated 2 years ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆276Updated 6 months ago
• Guangxuan-Xiao / torch-int
  This repository contains integer operators on GPUs for PyTorch.
  ☆237Updated 2 years ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆279Updated 3 months ago
• spcl / QuaRot
  Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.
  ☆480Updated last year
• naver-aics / lut-gemm
  ☆84Updated last year
• ruikangliu / FlatQuant
  [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"
  ☆208Updated 2 months ago
• ROCm / composable_kernel
  [DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror
  ☆518Updated this week
• facebookresearch / SpinQuant
  Code repo for the paper "SpinQuant LLM quantization with learned rotations"
  ☆372Updated 11 months ago
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆427Updated this week
• ColfaxResearch / cutlass-kernels
  ☆259Updated last year
• microsoft / SparTA
  ☆164Updated last year
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆256Updated last year
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆140Updated last week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆226Updated this week
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆405Updated 3 weeks ago
• ColfaxResearch / cfx-article-src
  ☆173Updated 9 months ago
• sunlex0717 / DissectingTensorCores
  ☆111Updated last year
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆348Updated this week
• BrotherHappy / OSTQuant
  [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…
  ☆88Updated 9 months ago
• mit-han-lab / omniserve
  [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…
  ☆810Updated 11 months ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆520Updated last year
• clevercool / ANT-Quantization
  ☆113Updated 2 years ago
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆325Updated 2 months ago
• IST-DASLab / qutlass
  QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning
  ☆165Updated 2 months ago
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆68Updated last year
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆335Updated last year
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆213Updated last week