Alternatives and similar repositories for cuda_latency_benchmark

Users that are interested in cuda_latency_benchmark are comparing it to the libraries listed below

• Libraries-Openly-Fused / FusedKernelLibrary
  Implementation of a methodology that allows all sorts of user defined GPU kernel fusion, for non CUDA programmers.
  ☆32Updated last week
• sslab-gatech / SysGPT
  Principles and Methodologies for Serial Performance Optimization (OSDI' 25)
  ☆20Updated 6 months ago
• kuterd / opal_ptx
  Experimental GPU language with meta-programming
  ☆24Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• belindal / state-tracking
  Code and data for paper "(How) do Language Models Track State?"
  ☆21Updated 8 months ago
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆113Updated 10 months ago
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆178Updated last week
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆53Updated 8 months ago
• Chris-hughes10 / simple-ppo
  A clean, modular implementation of the Proximal Policy Optimization (PPO) algorithm in PyTorch, written with a strong focus on readabilit…
  ☆19Updated last year
• IST-DASLab / llmq
  Quantized LLM training in pure CUDA/C++.
  ☆221Updated this week
• SusCom-Lab / ZSMerge
  ☆19Updated 2 months ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆105Updated 5 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆94Updated 6 months ago
• deepreinforce-ai / CUDA-L1
  CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
  ☆275Updated last month
• gpu-mode / triton-tutorials
  ☆15Updated 7 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆113Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆49Updated last year
• GusLovesMath / Llama3_MacSilicon
  Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework…
  ☆11Updated last year
• tonyzhang617 / nomad-dist
  ☆39Updated last year
• eth-easl / deltazip
  Compression for Foundation Models
  ☆34Updated 4 months ago
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆108Updated last year
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated last year
• cake-lab / DELI
  Optimizing loading training data from cloud bucket storage for cloud-based distributed deep learning. Official repository for Quantifying…
  ☆11Updated 3 years ago
• vedantroy / gpu_kernels
  ☆27Updated last year
• facebookresearch / any4
  Quantize transformers to any learned arbitrary 4-bit numeric format
  ☆50Updated 5 months ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆48Updated last year
• facebookresearch / loop_nest
  Loop Nest - Linear algebra compiler and code generator.
  ☆21Updated 3 years ago
• cchan / tccl
  extensible collectives library in triton
  ☆91Updated 8 months ago
• lmgame-org / GRL
  Multi-Turn RL Training System with AgentTrainer for Language Model Game Reinforcement Learning
  ☆54Updated last month
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆27Updated this week