Alternatives and similar repositories for cuda_latency_benchmark

Users that are interested in cuda_latency_benchmark are comparing it to the libraries listed below

• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆108Updated last year
• Libraries-Openly-Fused / FusedKernelLibrary
  Implementation of a methodology that allows all sorts of user defined GPU kernel fusion, for non CUDA programmers.
  ☆25Updated 2 weeks ago
• SakanaAI / robust-kbench
  ☆40Updated 3 weeks ago
• cake-lab / DELI
  Optimizing loading training data from cloud bucket storage for cloud-based distributed deep learning. Official repository for Quantifying…
  ☆11Updated 3 years ago
• lucidrains / firefly-torch
  Exploration into the Firefly algorithm in Pytorch
  ☆41Updated 8 months ago
• sslab-gatech / SysGPT
  Principles and Methodologies for Serial Performance Optimization (OSDI' 25)
  ☆16Updated 4 months ago
• GusLovesMath / Llama3_MacSilicon
  Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework…
  ☆11Updated last year
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆91Updated 4 months ago
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆107Updated 8 months ago
• facebookresearch / loop_nest
  Loop Nest - Linear algebra compiler and code generator.
  ☆21Updated 2 years ago
• Jokeren / triton-samples
  ☆28Updated 8 months ago
• CisMine / Guide-NVIDIA-Tools
  NVIDIA tools guide
  ☆143Updated 9 months ago
• UmerHA / triton_util
  Make triton easier
  ☆48Updated last year
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆22Updated last year
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆53Updated 3 weeks ago
• tonyzhang617 / nomad-dist
  ☆38Updated last year
• belindal / state-tracking
  Code and data for paper "(How) do Language Models Track State?"
  ☆19Updated 6 months ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆48Updated 6 months ago
• intel / tiny-dpcpp-nn
  SYCL implementation of Fused MLPs for Intel GPUs
  ☆47Updated 4 months ago
• meta-pytorch / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆45Updated last month
• ailzhang / minPP
  Pipeline parallelism for the minimalist
  ☆35Updated 2 months ago
• ahennequ / cuda-tensorcores-register-mapping
  ☆19Updated 3 years ago
• microsoft / AttentionEngine
  ☆100Updated 4 months ago
• kuterd / opal_ptx
  Experimental GPU language with meta-programming
  ☆23Updated last year
• fabiocannizzo / FastBinarySearch
  Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers
  ☆151Updated 9 months ago
• ytgui / PilotANN
  Memory-Bounded GPU Acceleration for Vector Search
  ☆27Updated 6 months ago
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆64Updated 6 months ago
• lucidrains / sinkhorn-router-pytorch
  Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
  ☆39Updated last year
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆98Updated 3 months ago