High Performance Int8 GEMM Kernels for SM80 and later GPUs.
β24Mar 11, 2025Updated last year
Alternatives and similar repositories for gemm-int8
Users that are interested in gemm-int8 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.β21Jan 24, 2025Updated last year
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. π The official implementation of https://arxβ¦β32Feb 17, 2025Updated last year
- This repository presents the source code for the paper "MILLION: Mastering Long-Context LLM Inference Via Outlier-Immunized KV Product Quβ¦β25Sep 1, 2026Updated last month
- PyTorch Quantization Framework For OCP MX Datatypes.β16May 30, 2025Updated last year
- A fork of the PEFT library, supporting Robust Adaptation (RoSA)β15Aug 16, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- IntLLaMA: A fast and light quantization solution for LLaMAβ19Jul 21, 2023Updated 3 years ago
- Computer programming - ShanghaiTechβ12Jan 10, 2020Updated 6 years ago
- iEDA water-drop training initiativeβ14Sep 10, 2024Updated 2 years ago
- β31Jun 15, 2022Updated 4 years ago
- GOMIL: Global Optimization of Multiplier by Integer Linear Programmingβ13Aug 25, 2021Updated 5 years ago
- ADAPTIVE RESONANCE THEORY. Gail A. Carpenter and Stephen Grossbergβ10Feb 10, 2015Updated 11 years ago
- Example of a full DC synthesis script for a simple designβ14Feb 25, 2019Updated 7 years ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.β102May 14, 2026Updated 5 months ago
- A basic SAT solver implementation for the Logics in Informatics courseβ10Mar 8, 2015Updated 11 years ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Innovus backend scriptsβ20Jun 20, 2022Updated 4 years ago
- Faster Pytorch bitsandbytes 4bit fp4 nn.Linear opsβ30Mar 16, 2024Updated 2 years ago
- β12Apr 3, 2023Updated 3 years ago
- Surgical GPU kernel benchmark: 7 hard problems, frontier coding agents, roofline-graded against hardware peak.β19Jun 12, 2026Updated 4 months ago
- β158Jun 22, 2023Updated 3 years ago
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA APIβ38Sep 15, 2023Updated 3 years ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.β15Aug 31, 2023Updated 3 years ago
- My solution code to parallel architecture and programming Spring 2016β12Aug 15, 2016Updated 10 years ago
- A DAG processor and compiler for a tree-based spatial datapath.β17Aug 24, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- β40Feb 28, 2020Updated 6 years ago
- LLM implementation one matrix multiplication at a timeβ14Aug 8, 2024Updated 2 years ago
- β20Mar 10, 2022Updated 4 years ago
- Llama causal LM fully recreated in LibTorch. Designed to be used in Unreal Engine 5β16Sep 19, 2024Updated 2 years ago
- λ μ΄μ±κ²μ(μΉ΄νΈλΌμ΄λ) μμ¨μ£Όν μΈκ³΅μ§λ₯ κ°λ°β10Jun 30, 2022Updated 4 years ago
- β89Apr 18, 2025Updated last year
- β19Nov 11, 2024Updated last year
- Out-of-distribution Detection via Generation - NeurIPS 2019β18Oct 5, 2019Updated 7 years ago
- Communication-Avoiding Recursive Matrix Multiplyβ19Jul 10, 2013Updated 13 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- β22Feb 5, 2024Updated 2 years ago
- β19Jan 4, 2024Updated 2 years ago
- GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks, NeurIPS 2022 Posterβ55Feb 18, 2023Updated 3 years ago
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)β46May 20, 2026Updated 4 months ago
- Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)β150Aug 18, 2020Updated 6 years ago
- RTL to GDS via Cadence Toolsβ20May 17, 2022Updated 4 years ago
- Implementation of Multiscreen proposed by Ken Nakanishi for "Screening is Enough"β19May 13, 2026Updated 5 months ago