Alternatives and similar repositories for FAMBench

Users that are interested in FAMBench are comparing it to the libraries listed below

• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• iree-org / iree-nvgpu
  ☆50Updated last year
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆97Updated last month
• deepspeedai / DeepSpeed-Kernels
  ☆72Updated 2 months ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆43Updated 3 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆109Updated 11 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated 3 months ago
• codeplaysoftware / cutlass-sycl
  A CUTLASS implementation using SYCL
  ☆27Updated this week
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆94Updated 6 years ago
• mlcommons / training_results_v1.0
  This repository contains the results and code for the MLPerf™ Training v1.0 benchmark.
  ☆38Updated last year
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated 2 years ago
• masahi / torchscript-to-tvm
  ☆69Updated 2 years ago
• microsoft / dist-ir
  An IR for efficiently simulating distributed ML computation.
  ☆28Updated last year
• Jokeren / triton-samples
  ☆28Updated 5 months ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆90Updated 2 weeks ago
• cchan / tccl
  extensible collectives library in triton
  ☆86Updated 2 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆110Updated 9 months ago
• saareliad / FTPipe
  FTPipe and related pipeline model parallelism research.
  ☆41Updated 2 years ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆116Updated 6 months ago
• sandeepkumar-skb / pytorch_custom_op
  End to End steps for adding custom ops in PyTorch.
  ☆23Updated 4 years ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• octoml / synr
  A library for syntactically rewriting Python programs, pronounced (sinner).
  ☆69Updated 3 years ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆66Updated this week
• Bruce-Lee-LY / cuda_hgemv
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆62Updated 9 months ago
• NVIDIA / LDDL
  Distributed preprocessing and data loading for language datasets
  ☆39Updated last year
• openxla / shardy
  MLIR-based partitioning system
  ☆91Updated this week
• YashasSamaga / ConvolutionBuildingBlocks
  GEMM and Winograd based convolutions using CUTLASS
  ☆26Updated 4 years ago
• nod-ai / techtalks
  ☆16Updated last year
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆92Updated 3 weeks ago