moritztng / grayskull-attention

Related projects: ⓘ

• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆79Updated 4 months ago
• tenstorrent / tt-mlir
  Tenstorrent MLIR compiler
  ☆52Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆124Updated last week
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆28Updated 6 months ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆73Updated 3 weeks ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA
  ☆48Updated this week
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆30Updated 4 months ago
• triton-lang / kernels
  ☆27Updated 3 weeks ago
• cuda-mode / triton-index
  Cataloging released Triton kernels.
  ☆111Updated 3 weeks ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆156Updated this week
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆54Updated this week
• iree-org / iree-turbine
  IREE's PyTorch Frontend, based on Torch Dynamo.
  ☆43Updated this week
• cuda-mode / ring-attention
  ring-attention experiments
  ☆89Updated 5 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆48Updated 2 weeks ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆35Updated 2 weeks ago
• manishucsd / py-codegen
  ☆14Updated 4 months ago
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆103Updated 5 months ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆46Updated 2 months ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆87Updated 3 months ago
• shadowpa0327 / Palu
  Code for Palu: Compressing KV-Cache with Low-Rank Projection
  ☆39Updated this week
• vdesai2014 / inference-optimization-blog-post
  ☆82Updated 6 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆81Updated 2 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆123Updated last month
• hao-ai-lab / MuxServe
  ☆30Updated 3 months ago
• fw-ai / llama-cuda-graph-example
  Example of applying CUDA graphs to LLaMA-v2
  ☆10Updated last year
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆11Updated 2 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆94Updated 2 weeks ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆93Updated last week
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆35Updated 4 months ago
• Jokeren / triton-samples
  ☆22Updated last week