Alternatives and similar repositories for open-gpu-kernel-modules

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• ReinForce-II / mmapeak
  ☆38Updated 4 months ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆124Updated 5 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆73Updated last week
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆154Updated 4 months ago
• Cornell-RelaxML / qtip
  ☆149Updated 2 months ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆129Updated last week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆162Updated last year
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆524Updated last week
• theroyallab / YALS
  ☆82Updated this week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 6 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆61Updated 10 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated last month
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆197Updated 2 weeks ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆484Updated this week
• jd-3d / SOLOBench
  ☆133Updated 3 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆196Updated last week
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆221Updated last year
• olealgoritme / gddr6
  Linux​ based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆103Updated 4 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆67Updated 7 months ago
• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆33Updated this week
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆73Updated 9 months ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆183Updated 2 weeks ago
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆127Updated last year
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆47Updated last year
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆63Updated 7 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆89Updated 3 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆54Updated 2 months ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆117Updated 3 weeks ago
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆52Updated 3 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆298Updated 3 months ago