Alternatives and similar repositories for open-gpu-kernel-modules:

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• mikex86 / LibreCuda
  ☆1,030Updated 4 months ago
• NousResearch / DisTrO
  Distributed Training Over-The-Internet
  ☆891Updated 3 months ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆2,184Updated this week
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆772Updated this week
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆747Updated 2 months ago
• Cornell-RelaxML / quip-sharp
  ☆529Updated 5 months ago
• IST-DASLab / marlin
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆775Updated 6 months ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆620Updated this week
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆2,483Updated this week
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆1,042Updated 10 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,366Updated this week
• tinygrad / 7900xtx
  ☆438Updated 2 weeks ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆463Updated 6 months ago
• KellerJordan / Muon
  Muon optimizer: +>30% sample efficiency with <3% wallclock overhead
  ☆529Updated this week
• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆771Updated this week
• mesozoic-egg / tinygrad-notes
  Tutorials on tinygrad
  ☆357Updated last month
• efeslab / Nanoflow
  A throughput-oriented high-performance serving framework for LLMs
  ☆782Updated 6 months ago
• vllm-project / llm-compressor
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
  ☆1,113Updated last week
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆524Updated last month
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆1,920Updated this week
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆732Updated last week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆222Updated this week
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,540Updated 4 months ago
• PrimeIntellect-ai / prime
  prime is a framework for efficient, globally distributed training of AI models over the internet.
  ☆682Updated last week
• PrimeIntellect-ai / OpenDiloco
  OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
  ☆474Updated 2 months ago
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…
  ☆2,299Updated this week
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆628Updated last month
• likejazz / llama3.np
  llama3.np is a pure NumPy implementation for Llama 3 model.
  ☆977Updated 9 months ago
• Infini-AI-Lab / Sequoia
  scalable and robust tree-based speculative decoding algorithm
  ☆340Updated 2 months ago
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆760Updated 7 months ago