Peter-Chou / libtorch_grpc_serving
pytorch during training, libtorch during serving via gRPC
☆21Updated 5 years ago
Alternatives and similar repositories for libtorch_grpc_serving
Users that are interested in libtorch_grpc_serving are comparing it to the libraries listed below
Sorting:
- libnms.so for object detection, can be use in libtorch or caffe or nccn or onnx or TensorRT☆17Updated 5 years ago
- Wanwu models release, code will be released soon☆24Updated 2 years ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Updated 4 years ago
- Validation of the PyTorch -> ONNX -> Intel OpenVino workflow using pretrained ResNet-50☆45Updated 6 years ago
- implement bert in pure c++☆36Updated 5 years ago
- ☆34Updated 6 years ago
- This is the re-implementation of group normalization in MXNet Symbol,Module and Gluon☆23Updated 5 years ago
- Serving PyTorch 1.0 Models as a Web Server in C++☆226Updated 5 years ago
- Single shot object detection in PyTorch☆7Updated 5 years ago
- convert pytorch trained yolo model to ncnn for Flexible deployment☆10Updated 6 years ago
- ☆14Updated 5 years ago
- ☆30Updated 5 years ago
- Simple examples of using bazel to cross compile AI applicaions for armv7hf devices.☆25Updated 3 years ago
- Whisper in TensorRT-LLM☆15Updated last year
- Locality-Aware Non-Maximum Suppression (C++ version)☆23Updated 3 years ago
- PyTorch 1.0 inference in C++ on Windows10 platforms☆89Updated 6 years ago
- Deploy SCRFD, an efficient high accuracy face detection approach, in your web browser with ncnn and webassembly☆52Updated 2 years ago
- Simple and Effective Face Detector, based on Progressive Calibration Networks (PCN) which is an accurate rotation-invariant face detector…☆24Updated 4 years ago
- Reimplement RetinaFace using PyTorch.☆74Updated 5 years ago
- mxnet-Gluon implementation of PSENet text detector (Shape Robust Text Detection with Progressive Scale Expansion Network)☆18Updated 5 years ago
- C++ client of a GAN model hosted by TensorFlow Serving☆11Updated 6 years ago
- Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…☆33Updated 3 years ago
- Main repository for Sampling Wisely: Deep Image by Top-k Precision Optimization☆40Updated 5 years ago
- A flexible Python front-end inference SDK based on TensorRT☆85Updated 4 years ago
- Real-time CPU person segmentation for privacy in video calls☆37Updated 4 years ago
- Pytorch2Caffe & Caffe2Pytorch☆8Updated 6 years ago
- ☆42Updated 4 years ago
- MXNet supports distributed training enabling us to leverage multiple machines for faster training.☆12Updated 6 years ago
- ☆25Updated 5 years ago
- MXNet prediction example☆13Updated 9 years ago