Alternatives and similar repositories for SDBI

Users that are interested in SDBI are comparing it to the libraries listed below

• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆97Updated 7 months ago
• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• OpenPPL / ppl.nn.llm
  ☆139Updated last year
• OpenPPL / ppl.llm.serving
  ☆127Updated 4 months ago
• Oneflow-Inc / oneflow-documentation
  oneflow documentation
  ☆68Updated 10 months ago
• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆104Updated 9 months ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 4 years ago
• Ascend / AscendSpeed
  ☆79Updated last year
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated 2 years ago
• BBuf / onnx_learn
  ☆99Updated 3 years ago
• volcengine / veGiantModel
  ☆216Updated last year
• MARD1NO / CUDA-PPT
  ☆91Updated last month
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆66Updated 3 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆43Updated 2 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆471Updated 3 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆284Updated 3 years ago
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆451Updated 5 years ago
• Oneflow-Inc / oneflow-xrt
  ☆23Updated 2 years ago
• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 2 years ago
• BBuf / how-to-optimize-gemm
  ☆96Updated 3 years ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆148Updated 4 months ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆160Updated last week
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆473Updated last year
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆139Updated 3 years ago
• OpenPPL / CuAssembler
  An unofficial cuda assembler, for all generations of SASS, hopefully ：）
  ☆83Updated 2 years ago
• tvmai / meetup-slides
  Place for meetup slides
  ☆140Updated 4 years ago
• DeepLink-org / dlinfer
  ☆48Updated last week
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆36Updated 2 months ago