Alternatives and similar repositories for gpu_topK_benchmark

Users that are interested in gpu_topK_benchmark are comparing it to the libraries listed below

• ParCIS / Magicube
  Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.
  ☆89Updated 2 years ago
• AlibabaResearch / recom
  An Optimizing Compiler for Recommendation Model Inference
  ☆26Updated 3 months ago
• parasailteam / coconet
  ☆82Updated 2 years ago
• Raphael-Hao / brainstorm
  Compiler for Dynamic Neural Networks
  ☆46Updated last year
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆132Updated 7 months ago
• EfficientLLMSys / MuxServe
  ☆13Updated last year
• HPMLL / NVIDIA-Hopper-Benchmark
  ☆57Updated 3 months ago
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆100Updated this week
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆165Updated this week
• rchardx / cuda-gemm
  ☆28Updated 5 months ago
• YukeWang96 / MGG_OSDI23
  Artifact for OSDI'23: MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Mult…
  ☆41Updated last year
• microsoft / ConvStencil
  ☆33Updated last year
• CalebDu / Awesome-Cute
  ☆103Updated 4 months ago
• apuaaChen / vectorSparse
  ☆32Updated 3 years ago
• yuyangJin / PerFlow-AI
  PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.
  ☆23Updated last week
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆54Updated last year
• AlibabaResearch / mononn
  ☆29Updated last year
• reed-lau / cute-gemm
  ☆132Updated 9 months ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆59Updated 2 weeks ago
• LoongServe / LoongServe
  ☆122Updated 10 months ago
• monellz / FlashTensor
  ☆14Updated 6 months ago
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆153Updated last year
• SJTU-IPADS / ugache
  ☆22Updated last year
• c3sr / tcu_scope
  ☆50Updated 6 years ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆91Updated 2 years ago
• HPMLL / DTC-SpMM_ASPLOS24
  ☆35Updated last year
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆63Updated last year
• TiledTensor / TiledCUDA
  We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …
  ☆185Updated 7 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆62Updated last year
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆110Updated last year