Alternatives and similar repositories for open-gpu-kernel-modules

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆218Updated 5 months ago
• LeanModels / DFloat11
  DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
  ☆592Updated last month
• ReinForce-II / mmapeak
  ☆49Updated last month
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆128Updated 10 months ago
• CerebrasResearch / reap
  REAP: Router-weighted Expert Activation Pruning for SMoE compression
  ☆203Updated last month
• Cornell-RelaxML / qtip
  ☆163Updated 6 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆69Updated 6 months ago
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆233Updated last week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆208Updated this week
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆165Updated 8 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆50Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆47Updated 2 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆220Updated 3 weeks ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆99Updated 7 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆154Updated 6 months ago
• IST-DASLab / Quartet
  ☆114Updated last week
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆326Updated last month
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆146Updated this week
• OpenMachine-ai / transformer-tricks
  A collection of tricks and tools to speed up transformer models
  ☆194Updated last month
• Thireus / GGUF-Tool-Suite
  Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…
  ☆76Updated this week
• mag- / gpu_benchmark
  Gpu benchmark
  ☆73Updated 11 months ago
• wdlctc / headinfer
  ☆63Updated 8 months ago
• intel / auto-round
  🎯An accuracy-first, highly efficient quantization toolkit for LLMs, designed to minimize quality degradation across Weight-Only Quantiza…
  ☆815Updated this week
• chigkim / Ollama-MMLU-Pro
  ☆108Updated 4 months ago
• jd-3d / SOLOBench
  ☆134Updated 8 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆87Updated this week
• SuriyaaMM / feather
  Lower Precision Floating Point Operations
  ☆62Updated last week
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆86Updated 8 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆617Updated this week