Alternatives and similar repositories for libtorch_grpc_serving

Users that are interested in libtorch_grpc_serving are comparing it to the libraries listed below

• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆36Updated 5 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago
• Wizaron / pytorch-cpp-inference
  Serving PyTorch 1.0 Models as a Web Server in C++
  ☆226Updated 5 years ago
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆140Updated 4 years ago
• Sundy1219 / ctc_beam_search_lm
  CTC+Beam_Search+kenlm 是用于以汉字为声学模型建模单元的解码系统
  ☆48Updated 7 years ago
• sunbelbd / mobius
  Möbius Transformation for Fast Inner Product Search on Graph
  ☆22Updated 4 years ago
• Peter-Chou / transformer_cpp_tokenizers
  transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)
  ☆17Updated 3 years ago
• AI-OP / edge-brain
  Simple examples of using bazel to cross compile AI applicaions for armv7hf devices.
  ☆25Updated 3 years ago
• ericperfect / libtorch_tokenizer
  BERT Tokenizer in C++
  ☆78Updated 4 years ago
• k9ele7en / Triton-TensorRT-Inference-CRAFT-pytorch
  Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…
  ☆33Updated 4 years ago
• kuangliu / pytorch-agender
  Predict age & gender in one model
  ☆19Updated 7 years ago
• markwwen / ServingAgent
  A simple middleware to improving GPU utilization then speedup online inference.
  ☆19Updated 4 years ago
• Abhijit-2592 / model-server
  gRPC server for hosting ML models trained on any framework in python
  ☆78Updated 2 months ago
• Zhengtq / ncnn_breakdown
  A breakdown of NCNN
  ☆46Updated 4 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 3 years ago
• vandyyu / dataset_labeling
  图片简易标注工具，标注类似ICDAR数据集，支持多边形标注，文本标注，方便OCR数据集标注。
  ☆55Updated 6 years ago
• Wanger-SJTU / CTC-loss-introduction
  介绍ctc算法原理以及numpy简单实现
  ☆64Updated 6 years ago
• markson14 / FaceRecognitionCpp
  Large input size REAL-TIME Face Detector on Cpp. It can also support face verification using MobileFaceNet+Arcface with real-time inferen…
  ☆53Updated 4 years ago
• nihui / ncnn-webassembly-scrfd
  Deploy SCRFD, an efficient high accuracy face detection approach, in your web browser with ncnn and webassembly
  ☆51Updated 2 years ago
• Arctanxy / ToyNet
  用C++和Python实现从头实现一个深度学习训练框架
  ☆12Updated 4 years ago
• venkatacrc / PyTorchCppFrontEnd
  PyTorch 1.5 C++ frontend API
  ☆20Updated 5 years ago
• saicoco / Gluon-PSENet
  mxnet-Gluon implementation of PSENet text detector (Shape Robust Text Detection with Progressive Scale Expansion Network)
  ☆18Updated 6 years ago
• watersink / grpc_tensorflow_demo
  tensorflow mnist demo api interface，include grpc,flask,webpy,tornado,django,rabbitMQ,redis,celery,tf serving，freeze_optimize_quantize
  ☆21Updated 3 years ago
• SURFZJY / EAST-caffe
  A Caffe implementation of EAST text detector
  ☆17Updated 5 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆16Updated 2 years ago
• hanson-young / ocr-table-ssd
  ☆25Updated 5 years ago
• ngeorgis / pytorch_onnx_openvino
  Validation of the PyTorch -> ONNX -> Intel OpenVino workflow using pretrained ResNet-50
  ☆44Updated 6 years ago
• lonePatient / MobileBert_PyTorch
  MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
  ☆69Updated 5 years ago
• haoxurt / tensorRT_save_serialization
  ☆13Updated 6 years ago
• chenjun2hao / facemask
  口罩检测。凑个热闹，和百度类似的是否佩戴口罩检测分类，但是速度会更快。
  ☆30Updated last year