Alternatives and similar repositories for gpu_topK_benchmark

Users that are interested in gpu_topK_benchmark are comparing it to the libraries listed below

• AlibabaResearch / recom
  An Optimizing Compiler for Recommendation Model Inference
  ☆24Updated 3 weeks ago
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆52Updated last year
• ParCIS / Magicube
  Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.
  ☆89Updated 2 years ago
• parasailteam / coconet
  ☆79Updated 2 years ago
• Raphael-Hao / brainstorm
  Compiler for Dynamic Neural Networks
  ☆46Updated last year
• microsoft / ConvStencil
  ☆30Updated last year
• rchardx / cuda-gemm
  ☆23Updated 2 months ago
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆48Updated 3 months ago
• CalebDu / Awesome-Cute
  ☆80Updated last month
• yuyangJin / PerFlow-AI
  PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.
  ☆19Updated last month
• EfficientLLMSys / MuxServe
  ☆13Updated last year
• HPMLL / SpInfer_EuroSys25
  ☆19Updated 2 months ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆49Updated 2 weeks ago
• YukeWang96 / MGG_OSDI23
  Artifact for OSDI'23: MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Mult…
  ☆39Updated last year
• SJTU-IPADS / ugache
  ☆22Updated last year
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆59Updated last year
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆143Updated last week
• apuaaChen / EVT_AE
  Artifacts of EVT ASPLOS'24
  ☆26Updated last year
• apuaaChen / vectorSparse
  ☆31Updated 2 years ago
• thunlp / Seq1F1B
  Sequence-level 1F1B schedule for LLMs.
  ☆28Updated last week
• HPMLL / DTC-SpMM_ASPLOS24
  ☆31Updated last year
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆92Updated 3 weeks ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆125Updated 5 months ago
• weishengying / cutlass_flash_atten_fp8
  使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention
  ☆71Updated 10 months ago
• YukeWang96 / QGTC_PPoPP22
  Artifact for PPoPP22 QGTC: Accelerating Quantized GNN via GPU Tensor Core.
  ☆29Updated 3 years ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆91Updated last year
• casys-kaist / HUVM
  ☆23Updated 2 years ago
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆80Updated last month
• AlibabaResearch / mononn
  ☆28Updated 11 months ago
• reed-lau / cute-gemm
  ☆123Updated 6 months ago