Alternatives and similar repositories for open-gpu-kernel-modules

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆128Updated 9 months ago
• ReinForce-II / mmapeak
  ☆48Updated last week
• CerebrasResearch / reap
  REAP: Router-weighted Expert Activation Pruning for SMoE compression
  ☆145Updated last week
• Cornell-RelaxML / qtip
  ☆159Updated 5 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆215Updated 4 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆50Updated last year
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆203Updated 2 weeks ago
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆220Updated this week
• LeanModels / DFloat11
  DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
  ☆572Updated 3 weeks ago
• Cornell-RelaxML / yaqa-quantization
  ☆66Updated 6 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆47Updated last month
• KONAKONA666 / q8_kernels
  ☆76Updated 11 months ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆143Updated this week
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆94Updated 6 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆73Updated 10 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆164Updated 7 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆317Updated 3 weeks ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆139Updated 4 months ago
• IST-DASLab / Quartet
  ☆113Updated last month
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆75Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆218Updated last month
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆85Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆94Updated this week
• snu-mllab / KVzip
  [NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)
  ☆169Updated 3 weeks ago
• reka-ai / rekaquant
  ☆62Updated 5 months ago
• wdlctc / headinfer
  ☆63Updated 7 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆103Updated this week
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆101Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆103Updated 7 months ago