Alternatives and similar repositories for open-gpu-kernel-modules

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆71Updated 4 months ago
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆426Updated last month
• ReinForce-II / mmapeak
  ☆28Updated 2 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated this week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆174Updated this week
• Cornell-RelaxML / qtip
  ☆137Updated this week
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆119Updated 3 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated last week
• theroyallab / YALS
  ☆78Updated this week
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆111Updated last week
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆43Updated 10 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆83Updated 3 weeks ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆608Updated this week
• olealgoritme / gddr6
  Linux​ based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆100Updated 2 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆408Updated last week
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆149Updated last month
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆31Updated 2 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆154Updated last year
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆129Updated this week
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆45Updated 4 months ago
• DeutscheKI / llm-performance-tests
  These are performance benchmarks we did to prepare for our own privacy-preserving and NDA-compliant in-house AI coding assistant. If by a…
  ☆25Updated 2 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆198Updated 11 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 4 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 8 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆273Updated last month
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆183Updated this week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆187Updated last week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆208Updated this week
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆54Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 6 months ago