Alternatives and similar repositories for cuda_latency_benchmark

Users that are interested in cuda_latency_benchmark are comparing it to the libraries listed below

• sslab-gatech / SysGPT
  Principles and Methodologies for Serial Performance Optimization (OSDI' 25)
  ☆21Updated 7 months ago
• Libraries-Openly-Fused / FusedKernelLibrary
  Implementation of a methodology that allows all sorts of user defined GPU kernel fusion, for non CUDA programmers.
  ☆37Updated this week
• GusLovesMath / Llama3_MacSilicon
  Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework…
  ☆11Updated last year
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆115Updated 11 months ago
• HazyResearch / HipKittens
  Fast and Furious AMD Kernels
  ☆331Updated 2 weeks ago
• eth-easl / deltazip
  Compression for Foundation Models
  ☆35Updated 5 months ago
• SusCom-Lab / ZSMerge
  ☆19Updated 3 months ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆53Updated 9 months ago
• facebookresearch / loop_nest
  Loop Nest - Linear algebra compiler and code generator.
  ☆21Updated 3 years ago
• ytgui / PilotANN
  Memory-Bounded GPU Acceleration for Vector Search
  ☆32Updated 2 weeks ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆46Updated 7 months ago
• hyhieu / easy_pybind
  ☆32Updated last year
• tonyzhang617 / nomad-dist
  ☆38Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• thuml / learn_torch.compile
  torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile
  ☆18Updated 2 years ago
• CisMine / Guide-NVIDIA-Tools
  NVIDIA tools guide
  ☆152Updated last year
• microsoft / AttentionEngine
  ☆116Updated 7 months ago
• manishucsd / py-codegen
  ☆16Updated last year
• Chris-hughes10 / simple-ppo
  A clean, modular implementation of the Proximal Policy Optimization (PPO) algorithm in PyTorch, written with a strong focus on readabilit…
  ☆19Updated last year
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆114Updated last year
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆104Updated 6 months ago
• SzymonOzog / Penny
  Hand-Rolled GPU communications library
  ☆76Updated last month
• fabiocannizzo / FastBinarySearch
  Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers
  ☆153Updated last year
• facebookresearch / any4
  Quantize transformers to any learned arbitrary 4-bit numeric format
  ☆50Updated 6 months ago
• facebookresearch / CUTracer
  A dynamic binary instrumentation tool for tracing and analyzing CUDA kernel instructions.
  ☆24Updated this week
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆22Updated 2 years ago
• lattice-land / cuda-battery
  Abstractions of memory, allocator, vector, tuple, shared_ptr, unique_ptr, bitset, variant and string working on both CPU and GPU
  ☆31Updated 5 months ago
• matheuslosilva / Hardware-Accelerated-Ant-Colony-Based-Swarm-System
  The proposal of this work involves a simulation of an ant colony swarm that was applied to a problem of search and rescue of objects of i…
  ☆12Updated 2 years ago
• vedantroy / gpu_kernels
  ☆27Updated 2 years ago
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆182Updated this week