Alternatives and similar repositories for SDBI

Users that are interested in SDBI are comparing it to the libraries listed below

• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆97Updated 8 months ago
• Oneflow-Inc / oneflow-documentation
  oneflow documentation
  ☆69Updated last year
• OpenPPL / ppl.nn.llm
  ☆139Updated last year
• OpenPPL / ppl.llm.serving
  ☆128Updated 6 months ago
• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• BBuf / onnx_learn
  ☆99Updated 3 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆285Updated 3 years ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 5 years ago
• volcengine / veGiantModel
  ☆220Updated last year
• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆104Updated 10 months ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• Ascend / AscendSpeed
  ☆79Updated last year
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆43Updated 2 years ago
• Oneflow-Inc / oneflow-xrt
  ☆23Updated 2 years ago
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated 2 years ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆148Updated 5 months ago
• whitelok / tvm-lesson
  动手学习TVM核心原理教程
  ☆62Updated 4 years ago
• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 2 years ago
• DeepLink-org / dlinfer
  ☆51Updated last week
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆474Updated last year
• Tlntin / ChatGLM2-6B-TensorRT
  ☆90Updated last year
• ModelTC / NART
  NART = NART is not A RunTime, a deep learning inference framework.
  ☆37Updated 2 years ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆38Updated 3 months ago
• tvmai / meetup-slides
  Place for meetup slides
  ☆140Updated 4 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆70Updated 2 years ago
• BBuf / how-to-optimize-gemm
  ☆96Updated 3 years ago
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆451Updated 5 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆471Updated 3 years ago
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆66Updated 3 years ago