Alternatives and similar repositories for open-gpu-kernel-modules

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 4 months ago
• Cornell-RelaxML / qtip
  ☆130Updated 2 months ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆115Updated 2 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated 3 weeks ago
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆416Updated 2 weeks ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆519Updated this week
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆147Updated last month
• ReinForce-II / mmapeak
  ☆27Updated 2 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆272Updated 2 weeks ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆173Updated this week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆117Updated this week
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆129Updated 4 months ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆109Updated 2 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆59Updated 7 months ago
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆211Updated 6 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆43Updated 9 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆122Updated this week
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated 2 months ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆203Updated last week
• neuralmagic / AutoFP8
  ☆194Updated last month
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆65Updated last week
• Infini-AI-Lab / Sequoia
  scalable and robust tree-based speculative decoding algorithm
  ☆345Updated 4 months ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆106Updated this week
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆88Updated 6 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆153Updated last year
• theroyallab / YALS
  ☆75Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆201Updated this week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆251Updated 7 months ago
• wdlctc / headinfer
  ☆48Updated 3 weeks ago