Alternatives and similar repositories for custom_matmul_kernels

Users that are interested in custom_matmul_kernels are comparing it to the libraries listed below

• graphcore / poptorch
  PyTorch interface for the IPU
  ☆181Updated 2 years ago
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆182Updated last month
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆109Updated 3 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆160Updated 2 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆158Updated 4 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆279Updated 3 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆137Updated 3 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆117Updated last year
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆178Updated 2 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• YulhwaKim / cutlass_tilesparse
  CUDA templates for tile-sparse matrix multiplication based on CUTLASS.
  ☆50Updated 7 years ago
• lernapparat / torchhacks
  Hacks for PyTorch
  ☆19Updated 2 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 5 years ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆56Updated 3 years ago
• YashasSamaga / ConvolutionBuildingBlocks
  GEMM and Winograd based convolutions using CUTLASS
  ☆28Updated 5 years ago
• Chillee / CS344_2021
  Udacity CS344 Introduction to Parallell Programming (https://classroom.udacity.com/courses/cs344), with assignments/materials updated to …
  ☆46Updated 4 years ago
• ahennequ / cuda-tensorcores-register-mapping
  ☆19Updated 3 years ago
• google-research / sputnik
  A library of GPU kernels for sparse matrix operations.
  ☆283Updated 5 years ago
• facebookresearch / diffq
  DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …
  ☆237Updated 2 years ago
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆174Updated 4 years ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated 2 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆220Updated 3 years ago
• bwasti / pytorch_compiler_tutorial
  Codebase associated with the PyTorch compiler tutorial
  ☆47Updated 6 years ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• albanD / subclass_zoo
  ☆189Updated last year
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆164Updated last month
• zasdfgbnm / autonvtx
  Automatically insert nvtx ranges to PyTorch models
  ☆21Updated 4 years ago
• AminRezaei0x443 / memory-efficient-attention
  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
  ☆184Updated 3 years ago
• jansel / pytorch-jit-paritybench
  ☆41Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆82Updated 2 years ago