Alternatives and similar repositories for libtorch_grpc_serving:

Users that are interested in libtorch_grpc_serving are comparing it to the libraries listed below

• Wizaron / pytorch-cpp-inference
  Serving PyTorch 1.0 Models as a Web Server in C++
  ☆226Updated 5 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 4 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆35Updated 4 years ago
• k9ele7en / Triton-TensorRT-Inference-CRAFT-pytorch
  Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…
  ☆33Updated 3 years ago
• lucasjinreal / libnms
  libnms.so for object detection, can be use in libtorch or caffe or nccn or onnx or TensorRT
  ☆17Updated 5 years ago
• markwwen / ServingAgent
  A simple middleware to improving GPU utilization then speedup online inference.
  ☆19Updated 4 years ago
• ngeorgis / pytorch_onnx_openvino
  Validation of the PyTorch -> ONNX -> Intel OpenVino workflow using pretrained ResNet-50
  ☆45Updated 6 years ago
• szad670401 / tvm_mobilefacenet
  ☆34Updated 5 years ago
• sunbelbd / mobius
  Möbius Transformation for Fast Inner Product Search on Graph
  ☆23Updated 3 years ago
• zccyman / pytorch-inference
  PyTorch 1.0 inference in C++ on Windows10 platforms
  ☆89Updated 6 years ago
• UltronAI / pytorch-caffe
  Pytorch2Caffe & Caffe2Pytorch
  ☆8Updated 6 years ago
• Howave / RetinaFace-TVM
  ☆30Updated 5 years ago
• pertusa / mxnet_predict_cc
  MXNet prediction example
  ☆13Updated 9 years ago
• jianzhnie / GroupNorm-MXNet
  This is the re-implementation of group normalization in MXNet Symbol,Module and Gluon
  ☆23Updated 5 years ago
• dendisuhubdy / libtorch_examples
  Libtorch C++ Examples
  ☆53Updated 3 years ago
• deepinsight / mxnet-serving
  mxnet model serving study
  ☆27Updated 5 years ago
• Abhijit-2592 / model-server
  gRPC server for hosting ML models trained on any framework in python
  ☆78Updated last year
• BG2CRW / top_k_optimization
  Main repository for Sampling Wisely: Deep Image by Top-k Precision Optimization
  ☆40Updated 5 years ago
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆138Updated 3 years ago
• calmiLovesAI / EfficientNet_TensorFlow2
  A tensorflow2 implementation of EfficientNet.
  ☆31Updated 5 years ago
• Sundy1219 / ctc_beam_search_lm
  CTC+Beam_Search+kenlm 是用于以汉字为声学模型建模单元的解码系统
  ☆47Updated 6 years ago
• vbezgachev / tf_serving_cpp_client
  C++ client of a GAN model hosted by TensorFlow Serving
  ☆11Updated 6 years ago
• kuangliu / pytorch-agender
  Predict age & gender in one model
  ☆19Updated 7 years ago
• YongtaoGe / RetinaFace
  Reimplement RetinaFace using PyTorch.
  ☆74Updated 5 years ago
• mkolod / fast_upsampling
  ☆33Updated 9 months ago
• Clarence-wen / Ranger-tensorflow
  Radam+lookahead implemented by tensorflow
  ☆11Updated 5 years ago
• deepglint / eq-ncnn
  ☆42Updated 4 years ago
• maoweinuaa / Cartoonface-detection
  Base on retinaface and centerface modefied. frame work depend on pytorch.
  ☆32Updated 4 years ago