Peter-Chou / libtorch_grpc_serving
pytorch during training, libtorch during serving via gRPC
☆21Updated 5 years ago
Related projects: ⓘ
- ☆52Updated this week
- libnms.so for object detection, can be use in libtorch or caffe or nccn or onnx or TensorRT☆17Updated 5 years ago
- implement bert in pure c++☆30Updated 4 years ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Updated 3 years ago
- C++ client of a GAN model hosted by TensorFlow Serving☆11Updated 6 years ago
- Minimal example of using a traced huggingface transformers model with libtorch☆35Updated 4 years ago
- Validation of the PyTorch -> ONNX -> Intel OpenVino workflow using pretrained ResNet-50☆45Updated 5 years ago
- Wanwu models release, code will be released soon☆24Updated 2 years ago
- Serving PyTorch 1.0 Models as a Web Server in C++☆225Updated 4 years ago
- Libtorch C++ Examples☆52Updated 2 years ago
- PyTorch 1.0 inference in C++ on Windows10 platforms☆89Updated 5 years ago
- Simple examples of using bazel to cross compile AI applicaions for armv7hf devices.☆25Updated 2 years ago
- Möbius Transformation for Fast Inner Product Search on Graph☆23Updated 3 years ago
- This is the re-implementation of group normalization in MXNet Symbol,Module and Gluon☆23Updated 5 years ago
- ☆14Updated 4 years ago
- Optimizing keras models using Nvidia TensorRT☆13Updated 5 years ago
- Pytorch2Caffe & Caffe2Pytorch☆8Updated 5 years ago
- Whisper in TensorRT-LLM☆14Updated 11 months ago
- Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…☆31Updated 3 years ago
- ☆42Updated 4 years ago
- tensorflow mnist demo api interface,include grpc,flask,webpy,tornado,django,rabbitMQ,redis,celery,tf serving,freeze_optimize_quantize☆20Updated 2 years ago
- mxnet-Gluon implementation of PSENet text detector (Shape Robust Text Detection with Progressive Scale Expansion Network)☆18Updated 5 years ago
- convert pytorch trained yolo model to ncnn for Flexible deployment☆10Updated 6 years ago
- PyTorch -> ONNX -> TVM for autotuning☆24Updated 4 years ago
- ☆34Updated 5 years ago
- Caffe2 C++/Python tutorial with full demo☆39Updated 4 years ago
- Reimplement RetinaFace using PyTorch.☆74Updated 4 years ago
- TextBoxes: A Fast Text Detector with a Single Deep Neural Network https://github.com/MhLiao/TextBoxes 基于SSD改进 的文本检测算法,textBoxes_note记录了之…☆25Updated 6 years ago
- Locality-Aware Non-Maximum Suppression (C++ version)☆22Updated 3 years ago
- Text Detection by RetinaNet with PyTorch (Code will be released soon)☆10Updated 5 years ago