luongthecong123 / fp8-quant-matmulLinks
Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.
☆15Updated 3 weeks ago
Alternatives and similar repositories for fp8-quant-matmul
Users that are interested in fp8-quant-matmul are comparing it to the libraries listed below
Sorting:
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Updated 4 months ago
- ☆98Updated last month
- ☆21Updated 2 months ago
- Samples of good AI generated CUDA kernels☆90Updated 4 months ago
- Efficient implementation of DeepSeek Ops (Blockwise FP8 GEMM, MoE, and MLA) for AMD Instinct MI300X☆69Updated 2 months ago
- TritonParse: A Compiler Tracer, Visualizer, and mini-Reproducer for Triton Kernels☆152Updated this week
- High-Performance SGEMM on CUDA devices☆105Updated 8 months ago
- ☆59Updated 3 months ago
- It is an LLM-based AI agent, which can write correct and efficient gpu kernels automatically.☆32Updated last month
- Write a fast kernel and run it on Discord. See how you compare against the best!☆57Updated last week
- Learning about CUDA by writing PTX code.☆138Updated last year
- Experimental GPU language with meta-programming☆23Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 6 months ago
- coding CUDA everyday!☆61Updated 5 months ago
- ☆31Updated 4 months ago
- Quantized LLM training in pure CUDA/C++.☆32Updated last week
- Custom PTX Instruction Benchmark☆128Updated 7 months ago
- General Matrix Multiplication using NVIDIA Tensor Cores☆21Updated 8 months ago
- pytorch from scratch in pure C/CUDA and python☆41Updated 11 months ago
- ☆30Updated 3 months ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆99Updated 3 weeks ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆97Updated last week
- [WIP] Better (FP8) attention for Hopper☆33Updated 7 months ago
- CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning☆191Updated last month
- Hand-Rolled GPU communications library☆34Updated last week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆21Updated this week
- Implementation of a methodology that allows all sorts of user defined GPU kernel fusion, for non CUDA programmers.☆25Updated last week
- ☆42Updated 3 weeks ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆97Updated 3 months ago
- LLM Inference on consumer devices☆124Updated 6 months ago