High Performance Int8 GEMM Kernels for SM80 and later GPUs.
☆24Mar 11, 2025Updated last year
Alternatives and similar repositories for gemm-int8
Users that are interested in gemm-int8 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆32Feb 17, 2025Updated last year
- ☆11Aug 26, 2024Updated 2 years ago
- Pruner: A Draft-then-Verify Exploration Mechanism to Accelerate Tensor Program Tuning (ASPLOS'25)☆15Mar 31, 2025Updated last year
- This repository presents the source code for the paper "MILLION: Mastering Long-Context LLM Inference Via Outlier-Immunized KV Product Qu…☆26Sep 1, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆38Sep 15, 2023Updated 3 years ago
- PyTorch Quantization Framework For OCP MX Datatypes.☆16May 30, 2025Updated last year
- A fork of the PEFT library, supporting Robust Adaptation (RoSA)☆16Aug 16, 2024Updated 2 years ago
- This repository contains the official code for Energy Transformer---an efficient Energy-based Transformer variant for graph classificatio…☆27Jan 28, 2024Updated 2 years ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆19Jul 21, 2023Updated 3 years ago
- ☆158Jun 22, 2023Updated 3 years ago
- Open addressing hash table on C++☆14Jan 19, 2015Updated 11 years ago
- Computer programming - ShanghaiTech☆12Jan 10, 2020Updated 6 years ago
- Code for: Algorithm-hardware co-design of neuromorphic networks with dual memory pathways☆17Sep 18, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆31Jun 15, 2022Updated 4 years ago
- 🤖 A streamlined, easy‑to‑install implementation of Fourier Neural Operators for time‑dependent and cloud‑point learning tasks.☆10May 28, 2023Updated 3 years ago
- iEDA water-drop training initiative☆14Sep 10, 2024Updated 2 years ago
- A DSL for Stencil Codes☆14Nov 27, 2024Updated last year
- GOMIL: Global Optimization of Multiplier by Integer Linear Programming☆13Aug 25, 2021Updated 5 years ago
- A double-double and quad-double package for Fortran and C++☆28Oct 24, 2026Updated last week
- In this tutorial, you learn how to implement a design from RTL-to-GDSII using Synopsys tools.☆16Jun 28, 2025Updated last year
- ☆14Nov 18, 2025Updated 11 months ago
- Wisp: computer use for agents on macOS (accessibility tree + synthesized input + DevTools), with a CLI and MCP server☆19Sep 15, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Example of a full DC synthesis script for a simple design☆14Feb 25, 2019Updated 7 years ago
- Here are some implementations of basic hardware units in RTL language (verilog for now), which can be used for area/power evaluation and …☆16Aug 25, 2023Updated 3 years ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆104May 14, 2026Updated 5 months ago
- The initial version of paper" OpenACM: An Open-Source SRAM-Based Approximate CiM Compiler"☆23Jul 29, 2026Updated 3 months ago
- Implementation of Proximal Wavefunction Optimization (PWO)☆14Jul 27, 2026Updated 3 months ago
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆32Oct 30, 2024Updated 2 years ago
- Surgical GPU kernel benchmark: 7 hard problems, frontier coding agents, roofline-graded against hardware peak.☆19Jun 12, 2026Updated 4 months ago
- Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops☆30Mar 16, 2024Updated 2 years ago
- ☆12Apr 3, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15Jul 7, 2020Updated 6 years ago
- Flutter + Codemirror☆12Apr 3, 2021Updated 5 years ago
- A basic SAT solver implementation for the Logics in Informatics course☆10Mar 8, 2015Updated 11 years ago
- Hadamard-Preconditioned Adaptive Rotation Processor for Extreme LLM Quantization (EMNLP 2026)☆25Oct 14, 2026Updated 2 weeks ago
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆12Nov 8, 2024Updated last year
- Official repository for paper "DeepCritic: Deliberate Critique with Large Language Models"☆41Jun 24, 2025Updated last year
- ☆10Apr 5, 2025Updated last year