Alternatives and similar repositories for awesome-gpu-notes

Users that are interested in awesome-gpu-notes are comparing it to the libraries listed below

• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 5 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆37Updated 5 years ago
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆139Updated 4 years ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• NVIDIA / kmeans
  kmeans clustering with multi-GPU capabilities
  ☆122Updated 2 years ago
• huismiling / wenet_trt8
  ☆75Updated 3 years ago
• Tencent / WeChat-TFCC
  ☆129Updated 4 years ago
• dingyuqing05 / trt2022_wenet
  ☆70Updated 3 years ago
• carlushuang / cpu_gemm_opt
  how to design cpu gemm on x86 with avx256, that can beat openblas.
  ☆73Updated 6 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆170Updated last week
• Peter-Chou / transformer_cpp_tokenizers
  transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)
  ☆18Updated 3 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆480Updated 3 years ago
• xieyu / read-tf
  notes on reading tensorflow source code
  ☆13Updated 7 years ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆136Updated 2 years ago
• yuxianzhi / Top-K
  A way to use cuda to accelerate top k algorithm
  ☆30Updated 8 years ago
• OpenPPL / ppl.llm.serving
  ☆130Updated last year
• triton-inference-server / hugectr_backend
  ☆57Updated 2 years ago
• daquexian / faster-rwkv
  ☆125Updated 2 years ago
• XiuYuLi / flexible-gemm
  flexible-gemm conv of deepcore
  ☆17Updated 6 years ago
• XiaoMi / nnlib
  Fork of https://source.codeaurora.org/quic/hexagon_nn/nnlib
  ☆58Updated 2 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated 2 years ago
• Peter-Chou / libtorch_grpc_serving
  pytorch during training, libtorch during serving via gRPC
  ☆21Updated 6 years ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆51Updated 2 years ago
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆477Updated last year
• wangguojim / LargeScale
  ☆19Updated last year
• sallenkey-wei / cuda-handbook
  pdf
  ☆94Updated 7 years ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated 2 years ago
• NeuHub / TVMDeepDive
  ☆21Updated 6 years ago
• BBuf / how-to-optimize-gemm
  ☆97Updated 4 years ago
• netease-youdao / EMLL
  Edge Machine Learning Library
  ☆199Updated 3 years ago