tinygrad / open-gpu-kernel-modules

Related projects ⓘ

Alternatives and complementary repositories for open-gpu-kernel-modules

• mikex86 / LibreCuda
  ☆1,003Updated 3 weeks ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,661Updated this week
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆626Updated 7 months ago
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆702Updated this week
• Cornell-RelaxML / quip-sharp
  ☆505Updated 3 weeks ago
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆607Updated 4 months ago
• tinygrad / 7900xtx
  ☆382Updated this week
• NousResearch / DisTrO
  Distributed Training Over-The-Internet
  ☆688Updated 2 months ago
• mlecauchois / micrograd-cuda
  ☆234Updated 8 months ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆483Updated 3 weeks ago
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆986Updated 6 months ago
• PygmalionAI / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,140Updated this week
• kvcache-ai / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆737Updated last week
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,138Updated this week
• turboderp / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆3,680Updated this week
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆387Updated last month
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆214Updated 4 months ago
• likejazz / llama3.np
  llama3.np is a pure NumPy implementation for Llama 3 model.
  ☆976Updated 5 months ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆526Updated this week
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆309Updated 5 months ago
• XiongjieDai / GPU-Benchmarks-on-LLM-Inference
  Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
  ☆1,063Updated 6 months ago
• IST-DASLab / marlin
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆624Updated 2 months ago
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆1,452Updated this week
• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆509Updated this week
• trholding / llama2.c
  Llama 2 Everywhere (L2E)
  ☆1,511Updated 3 weeks ago
• AMD-AIG-AIMA / AMD-LLM
  ☆179Updated 2 months ago
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,246Updated 3 months ago
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆1,585Updated this week
• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆636Updated this week