☆190Sep 28, 2026Updated last month
Alternatives and similar repositories for Quark
Users that are interested in Quark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Tensor Engine for ROCm☆616Updated this week
- ☆127Feb 26, 2026Updated 8 months ago
- Build generative models in ONNX☆22Updated this week
- AMD PACE is a PyTorch extension for high-performance LLM inference on AMD CPUs. It provides a framework to develop and test novel optimiz…☆18Oct 21, 2026Updated 3 weeks ago
- Optimized FP16/BF16 x FP4 GPU kernels for AMD GPUs☆72Sep 5, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official Repository for "WUSH: Near-Optimal Adaptive Transforms for LLM Quantization" (ICML 2026)☆18Jun 30, 2026Updated 4 months ago
- ☆18Apr 7, 2025Updated last year
- ☆37Nov 4, 2026Updated 2 weeks ago
- PyTorch emulation library for Microscaling (MX)-compatible data formats☆363Jul 17, 2026Updated 4 months ago
- AiTer Optimized Model☆207Updated this week
- FlashInfer+ROCm: ROCm port of FlashInfer☆13Updated this week
- Code implementation of GPTAQ (https://arxiv.org/abs/2504.02692)☆100Jul 28, 2025Updated last year
- [EMNLP 2025] AMQ: Enabling AutoML for Mixed-precision Weight-Only Quantization of Large Language Models☆31Apr 29, 2026Updated 6 months ago
- ☆16Nov 11, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repository contains low-bit quantization papers from 2020 to 2026 on top conference.☆236Aug 22, 2026Updated 2 months ago
- Fast low-bit matmul kernels in Triton☆493Oct 1, 2026Updated last month
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆542Nov 26, 2024Updated last year
- ☆24Aug 24, 2026Updated 2 months ago
- ☆31Updated this week
- [ICML 2025] MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design☆33Jul 4, 2025Updated last year
- ☆130Mar 18, 2026Updated 8 months ago
- PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度☆1,707Updated this week
- [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.☆755May 14, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆54May 20, 2025Updated last year
- ☆11Nov 16, 2024Updated 2 years ago
- ☆173Mar 9, 2023Updated 3 years ago
- Official implementation for Training LLMs with MXFP4☆131Apr 25, 2025Updated last year
- ROCm CLI is a command-line tool for setting up and running local AI on AMD GPUs, with a full-screen TUI dashboard for GPU telemetry, mode…☆53Updated this week
- The official code implementation for paper "PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs"☆33May 24, 2025Updated last year
- State-of-the-art LLM compression, built for production inference with vLLM☆3,974Updated this week
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆38Aug 29, 2025Updated last year
- AMD related optimizations for transformer models☆102Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…☆98Apr 8, 2025Updated last year
- A safetensors extension to efficiently store sparse quantized tensors on disk☆338Updated this week
- ☆11Apr 5, 2023Updated 3 years ago
- LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascen…☆1,293Updated this week
- Official AMD catalog of AI agent skills. Empower your AI agents with AMD's optimized SW stack.☆500Updated this week
- PyTorch native quantization for training and inference☆3,032Updated this week
- A retargetable and extensible synthesis-based compiler for modern hardware architectures☆22Nov 20, 2025Updated 11 months ago
Are these results useful?