Alternatives and similar repositories for SDBI:

Users that are interested in SDBI are comparing it to the libraries listed below

• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆96Updated 4 months ago
• OpenPPL / ppl.nn.llm
  ☆139Updated 10 months ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• Oneflow-Inc / oneflow-documentation
  oneflow documentation
  ☆68Updated 8 months ago
• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 4 years ago
• OpenPPL / ppl.llm.serving
  ☆127Updated 2 months ago
• BBuf / onnx_learn
  ☆97Updated 3 years ago
• volcengine / veGiantModel
  ☆213Updated last year
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆285Updated 2 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆155Updated this week
• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆105Updated 6 months ago
• MARD1NO / CUDA-PPT
  ☆80Updated last year
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆451Updated 4 years ago
• Oneflow-Inc / oneflow-xrt
  ☆23Updated last year
• Ascend / AscendSpeed
  ☆76Updated last year
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆66Updated 3 years ago
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆137Updated 3 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆42Updated last year
• HadXu / Thunder
  A small deep-learning framework with C++/Python/CUDA
  ☆53Updated 6 years ago
• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 2 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆470Updated 2 years ago
• aliyun / alibabacloud-aiacc-demo
  alibabacloud-aiacc-demo
  ☆42Updated last year
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆35Updated this week
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• BBuf / how-to-optimize-gemm
  ☆95Updated 3 years ago
• whitelok / tvm-lesson
  动手学习TVM核心原理教程
  ☆60Updated 4 years ago
• AyakaGEMM / Hands-on-GEMM
  ☆111Updated 11 months ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆142Updated last month
• keithyin / read-pytorch-source-code
  pytorch源码阅读 0.2.0 版本
  ☆90Updated 5 years ago