Alternatives and similar repositories for libtorch_grpc_serving:

Users that are interested in libtorch_grpc_serving are comparing it to the libraries listed below

• Wizaron / pytorch-cpp-inference
  Serving PyTorch 1.0 Models as a Web Server in C++
  ☆226Updated 5 years ago
• jianzhnie / GroupNorm-MXNet
  This is the re-implementation of group normalization in MXNet Symbol,Module and Gluon
  ☆23Updated 5 years ago
• lucasjinreal / libnms
  libnms.so for object detection, can be use in libtorch or caffe or nccn or onnx or TensorRT
  ☆17Updated 5 years ago
• dendisuhubdy / libtorch_examples
  Libtorch C++ Examples
  ☆53Updated 3 years ago
• markwwen / ServingAgent
  A simple middleware to improving GPU utilization then speedup online inference.
  ☆19Updated 4 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 4 years ago
• TengFeiHan0 / CenterMask_plus
  ☆14Updated 4 years ago
• saicoco / Gluon-PSENet
  mxnet-Gluon implementation of PSENet text detector (Shape Robust Text Detection with Progressive Scale Expansion Network)
  ☆18Updated 5 years ago
• jack-willturner / pytorch-onnx-tvm
  PyTorch -> ONNX -> TVM for autotuning
  ☆23Updated 5 years ago
• szad670401 / tvm_mobilefacenet
  ☆34Updated 5 years ago
• pertusa / mxnet_predict_cc
  MXNet prediction example
  ☆13Updated 9 years ago
• hanson-young / ocr-table-ssd
  ☆25Updated 5 years ago
• Abhijit-2592 / model-server
  gRPC server for hosting ML models trained on any framework in python
  ☆78Updated last year
• sunbelbd / mobius
  Möbius Transformation for Fast Inner Product Search on Graph
  ☆23Updated 3 years ago
• zccyman / pytorch-inference
  PyTorch 1.0 inference in C++ on Windows10 platforms
  ☆89Updated 6 years ago
• pengfeidip / refindeDet_Pytorch
  pytorch based refineDet learning base on https://github.com/luuuyi/RefineDet.PyTorch
  ☆8Updated 5 years ago
• Media-Smart / cheetahinfer
  A C++ inference SDK based on TensorRT
  ☆70Updated 4 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• abeardear / ncnn-yolo
  convert pytorch trained yolo model to ncnn for Flexible deployment
  ☆10Updated 6 years ago
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆137Updated 3 years ago
• BG2CRW / top_k_optimization
  Main repository for Sampling Wisely: Deep Image by Top-k Precision Optimization
  ☆40Updated 5 years ago
• laggui / pytorch-cpp
  Just messing around with PyTorch 1.0's JIT compiler and their new C++ API Libtorch.
  ☆19Updated 5 years ago
• Sundy1219 / ctc_beam_search_lm
  CTC+Beam_Search+kenlm 是用于以汉字为声学模型建模单元的解码系统
  ☆46Updated 6 years ago
• faedtodd / Tensorrt-yolov3-win10
  onnx-tensorrt for yolov3
  ☆30Updated 5 years ago
• srihari-humbarwadi / TensorRT-for-keras
  Optimizing keras models using Nvidia TensorRT
  ☆13Updated 5 years ago
• deepglint / eq-ncnn
  ☆42Updated 4 years ago
• calmiLovesAI / EfficientNet_TensorFlow2
  A tensorflow2 implementation of EfficientNet.
  ☆31Updated 5 years ago
• syshensyshen / pva-mobilenet-v2
  using pvanet framework train mobilenet-v2 for objects detection, papaer: https://arxiv.org/abs/1611.08588
  ☆13Updated 6 years ago
• tebesu / pytorch-cpp-tutorial
  Example code to create and train a Pytorch model using the new C++ frontend.
  ☆17Updated 5 years ago