Alternatives and similar repositories for Quark

Users that are interested in Quark are comparing it to the libraries listed below

• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆241Updated last week
• Qualcomm-AI-research / FP8-quantization
  ☆149Updated 2 years ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆122Updated this week
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆110Updated 6 months ago
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆97Updated this week
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆619Updated last month
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆401Updated this week
• sunlex0717 / DissectingTensorCores
  ☆96Updated last year
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆251Updated 7 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆311Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆201Updated this week
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆195Updated last year
• accel-sim / gpgpu-sim_distribution
  GPGPU-Sim provides a detailed simulation model of a contemporary GPU running CUDA and/or OpenCL workloads and now includes an integrated…
  ☆54Updated this week
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆118Updated last year
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆97Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆187Updated this week
• naver-aics / lut-gemm
  ☆59Updated last year
• clevercool / ANT-Quantization
  ☆98Updated last year
• ColfaxResearch / cutlass-kernels
  ☆208Updated 10 months ago
• RRZE-HPC / gpu-benches
  collection of benchmarks to measure basic GPU capabilities
  ☆377Updated 3 months ago
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆38Updated 10 months ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆149Updated last week
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆189Updated 10 months ago
• Guangxuan-Xiao / torch-int
  This repository contains integer operators on GPUs for PyTorch.
  ☆205Updated last year
• ColfaxResearch / cfx-article-src
  ☆110Updated 3 weeks ago
• areuther / ai-accelerators
  CSV spreadsheets and other material for AI accelerator survey papers
  ☆169Updated last year
• Xilinx / llvm-aie
  Fork of LLVM to support AMD AIEngine processors
  ☆143Updated this week
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆211Updated last year
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆109Updated 10 months ago
• spcl / QuaRot
  Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.
  ☆390Updated 6 months ago