Alternatives and similar repositories for fast.cu:

Users that are interested in fast.cu are comparing it to the libraries listed below

• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆185Updated this week
• ColfaxResearch / cutlass-kernels
  ☆177Updated 5 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆93Updated 5 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆76Updated 3 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆169Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆88Updated 2 months ago
• triton-lang / kernels
  ☆64Updated 2 months ago
• ColfaxResearch / cfx-article-src
  ☆65Updated 3 weeks ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆208Updated 3 weeks ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆147Updated this week
• triton-lang / triton-cpu
  An experimental CPU backend for Triton
  ☆73Updated 2 weeks ago
• andylolu2 / simpleGEMM
  The simplest but fast implementation of matrix multiplication in CUDA.
  ☆34Updated 5 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆214Updated this week
• yifuwang / symm-mem-recipes
  ☆26Updated 2 weeks ago
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆149Updated 5 months ago
• TiledTensor / TiledCUDA
  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
  ☆171Updated last month
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆229Updated 2 months ago
• wangzyon / NVIDIA_SGEMM_PRACTICE
  Step-by-step optimization of CUDA SGEMM
  ☆261Updated 2 years ago
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆265Updated 2 months ago
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆268Updated last month
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆307Updated 3 months ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆37Updated 7 months ago
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆216Updated this week
• stanford-futuredata / stk
  ☆95Updated 4 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆63Updated 4 months ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆217Updated 5 months ago
• Bruce-Lee-LY / cuda_hgemv
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆54Updated 4 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆57Updated 2 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• AlibabaPAI / FLASHNN
  ☆79Updated 4 months ago