Alternatives and similar repositories for open-gpu-kernel-modules

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• ReinForce-II / mmapeak
  ☆31Updated 3 months ago
• Cornell-RelaxML / qtip
  ☆139Updated 3 weeks ago
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆446Updated last month
• olealgoritme / gddr6
  Linux​ based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆101Updated 2 months ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆177Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆652Updated this week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 5 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆84Updated last month
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆156Updated last year
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆121Updated 4 months ago
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆33Updated last year
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆43Updated 10 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆63Updated 5 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆277Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆187Updated this week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆135Updated this week
• IST-DASLab / Quartet
  ☆71Updated 2 weeks ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆436Updated this week
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆153Updated 2 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 5 months ago
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆232Updated this week
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆132Updated 5 months ago
• IST-DASLab / MoE-Quant
  Code for data-aware compression of DeepSeek models
  ☆36Updated last month
• Cornell-RelaxML / yaqa-quantization
  ☆41Updated 3 weeks ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆116Updated 2 weeks ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆198Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• intel / auto-round
  Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU. Seamlessly integrated with Torchao, Tra…
  ☆528Updated this week
• sekstini / gpupoor
  ☆17Updated 7 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆94Updated this week