Alternatives and similar repositories for open-gpu-kernel-modules:

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆142Updated this week
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆37Updated 7 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆222Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆114Updated this week
• mag- / gpu_benchmark
  Gpu benchmark
  ☆57Updated 2 months ago
• Cornell-RelaxML / qtip
  ☆112Updated this week
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆87Updated 2 months ago
• amd / fuzzyHSA
  ☆54Updated 9 months ago
• anthonix / llm.c
  LLM training in simple, raw C/HIP for AMD GPUs
  ☆44Updated 6 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆272Updated this week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆163Updated this week
• crashr / gppm
  GPU Power and Performance Manager
  ☆57Updated 5 months ago
• SJTU-IPADS / Bamboo
  Bamboo-7B Large Language Model
  ☆92Updated last year
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆71Updated 4 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆70Updated last month
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆67Updated this week
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆102Updated 2 weeks ago
• xor2k / gpu_undervolt
  ☆40Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆21Updated 9 months ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆40Updated 2 weeks ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆102Updated 8 months ago
• KONAKONA666 / q8_kernels
  ☆65Updated 3 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated 5 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆235Updated last month
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆60Updated last week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆91Updated this week
• 0xD0GF00D / DocumentSASS
  Unofficial description of the CUDA assembly (SASS) instruction sets.
  ☆76Updated 3 weeks ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆262Updated 5 months ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆56Updated last week