Alternatives and similar repositories for libdeepvac

Users that are interested in libdeepvac are comparing it to the libraries listed below

• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• BBuf / onnx_learn
  ☆99Updated 3 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆160Updated 2 weeks ago
• huismiling / wenet_trt8
  ☆75Updated 2 years ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 5 years ago
• BBuf / onnx2X
  ONNX2Pytorch
  ☆162Updated 4 years ago
• bindog / onnx-surgery
  ☆80Updated 4 years ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• tenglike1997 / onnxruntime-projects
  Code for some onnxruntime projects
  ☆122Updated 4 years ago
• grimoire / amirstan_plugin
  Useful tensorrt plugin. For pytorch and mmdetection model conversion.
  ☆164Updated 8 months ago
• lucasjinreal / thor
  thor: C++ helper library, for deep learning purpose
  ☆277Updated 2 years ago
• wang-xinyu / pytorchx
  Implement popular deep learning networks in pytorch, used by tensorrtx.
  ☆196Updated 3 years ago
• BBuf / ArmNeonOptimization
  arm-neon
  ☆90Updated 10 months ago
• drcut / NN_transform
  Trans different platform's network to International Representation(IR)
  ☆44Updated 7 years ago
• BIGBALLON / PyTorch-CPP
  PyTorch C++ inference with LibTorch
  ☆329Updated 4 years ago
• ChenShisen / ncnnqat
  quantize aware training package for NCNN on pytorch
  ☆70Updated 3 years ago
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆451Updated 5 years ago
• RizhaoCai / PyTorch_ONNX_TensorRT
  A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX
  ☆247Updated 4 years ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆260Updated last year
• aovoc / nnieqat-pytorch
  A nnie quantization aware training tool on pytorch.
  ☆239Updated 4 years ago
• saurabh-shandilya / onnx-utils
  Utility scripts for editing or modifying onnx models. Utility scripts to summarize onnx model files along with visualization for loop ope…
  ☆79Updated 3 years ago
• lyuchuny3 / Tengine_gemm_tutorial
  Tengine gemm tutorial, step by step
  ☆13Updated 4 years ago
• zzk0 / triton
  Triton Inferece Server Model Config and Client Scripts
  ☆32Updated 3 years ago
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆112Updated 2 years ago
• AI-performance / embedded-ai.bench
  benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
  ☆204Updated 4 years ago
• bug-developer021 / YOLOV5_optimization_on_triton
  Compare multiple optimization methods on triton to imporve model service performance
  ☆52Updated last year
• inisis / Capella
  Cuda Version Image Processing API
  ☆40Updated 6 years ago
• haoxurt / tensorRT_save_serialization
  ☆13Updated 6 years ago
• xn1997 / TensorRT-EinsumPlugin
  ☆26Updated 3 years ago
• Wanger-SJTU / CTC-loss-introduction
  介绍ctc算法原理以及numpy简单实现
  ☆61Updated 5 years ago