☆186Sep 28, 2026Updated last month
Alternatives and similar repositories for Quark
Users that are interested in Quark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Tensor Engine for ROCm☆599Updated this week
- ☆127Feb 26, 2026Updated 8 months ago
- Optimized FP16/BF16 x FP4 GPU kernels for AMD GPUs☆70Sep 5, 2026Updated last month
- PyTorch emulation library for Microscaling (MX)-compatible data formats☆365Jul 17, 2026Updated 3 months ago
- ROCm CLI is a command-line tool for setting up and running local AI on AMD GPUs, with a full-screen TUI dashboard for GPU telemetry, mode…☆49Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆31Jan 20, 2026Updated 9 months ago
- This repository contains low-bit quantization papers from 2020 to 2026 on top conference.☆229Aug 22, 2026Updated 2 months ago
- Fast low-bit matmul kernels in Triton☆490Oct 1, 2026Updated 3 weeks ago
- LLM Inference with Microscaling Format☆35Nov 12, 2024Updated last year
- Official AMD catalog of AI agent skills. Empower your AI agents with AMD's optimized SW stack.☆470Updated this week
- ☆53May 20, 2025Updated last year
- ☆11Nov 16, 2024Updated last year
- AiTer Optimized Model☆202Updated this week
- The official code implementation for paper "PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs"☆33May 24, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆540Nov 26, 2024Updated last year
- Official implementation for Training LLMs with MXFP4☆130Apr 25, 2025Updated last year
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆38Aug 29, 2025Updated last year
- AMD related optimizations for transformer models☆102Oct 14, 2026Updated 2 weeks ago
- ☆129Mar 18, 2026Updated 7 months ago
- ☆11Apr 5, 2023Updated 3 years ago
- [ICML 2026] NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models☆24Jul 3, 2026Updated 3 months ago
- ☆10Jun 19, 2025Updated last year
- ☆18Apr 7, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [EMNLP 2025] AMQ: Enabling AutoML for Mixed-precision Weight-Only Quantization of Large Language Models☆31Apr 29, 2026Updated 6 months ago
- ☆16Nov 11, 2025Updated 11 months ago
- Frequency-based KV cache pruning for llama.cpp — 25% cache reduction, improved PPL at long context. GPU compaction kernel for HIP/ROCm.☆16Apr 18, 2026Updated 6 months ago
- A tool for generating information about the matrix multiplication instructions in AMD Radeon™ and AMD Instinct™ accelerators☆146Oct 22, 2026Updated last week
- Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).☆125Jul 11, 2026Updated 3 months ago
- Rust library for BirdNET and Perch ONNX model inference with CUDA GPU support☆11Oct 22, 2026Updated last week
- [NAACL' 25 main] Lillama: Large Language Model Compression via Low-Rank Feature Distillation☆11Apr 10, 2025Updated last year
- Development repository for the Triton language and compiler☆146Updated this week
- ☆173Mar 9, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"☆11Mar 31, 2024Updated 2 years ago
- Modular RDMA Interface☆189Updated this week
- Evalution: evolve your LLMs with better evals.☆16Sep 26, 2026Updated last month
- LLM inference in C/C++☆27Updated this week
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆229Nov 25, 2025Updated 11 months ago
- LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM…☆1,281Updated this week
- This is a repository for documenting the setup and performance of MI100s in popular inference engines.☆19Oct 8, 2026Updated 3 weeks ago