Peter-Chou / libtorch_grpc_servingLinks
pytorch during training, libtorch during serving via gRPC
☆21Updated 5 years ago
Alternatives and similar repositories for libtorch_grpc_serving
Users that are interested in libtorch_grpc_serving are comparing it to the libraries listed below
Sorting:
- implement bert in pure c++☆35Updated 5 years ago
- Minimal example of using a traced huggingface transformers model with libtorch☆35Updated 4 years ago
- BERT Tokenizer in C++☆74Updated 4 years ago
- Use PyTorch model in C++ project☆139Updated 3 years ago
- Serving PyTorch 1.0 Models as a Web Server in C++☆226Updated 5 years ago
- Simple examples of using bazel to cross compile AI applicaions for armv7hf devices.☆25Updated 3 years ago
- Deploy SCRFD, an efficient high accuracy face detection approach, in your web browser with ncnn and webassembly☆51Updated 2 years ago
- Möbius Transformation for Fast Inner Product Search on Graph☆22Updated 4 years ago
- transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)☆17Updated 3 years ago
- Large input size REAL-TIME Face Detector on Cpp. It can also support face verification using MobileFaceNet+Arcface with real-time inferen…☆51Updated 4 years ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Updated 4 years ago
- A C++ inference SDK based on TensorRT☆70Updated 4 years ago
- Pytorch2Caffe & Caffe2Pytorch☆8Updated 6 years ago
- Whisper in TensorRT-LLM☆16Updated last year
- gRPC server for hosting ML models trained on any framework in python☆78Updated last year
- Wanwu models release, code will be released soon☆24Updated 2 years ago
- C++ client of a GAN model hosted by TensorFlow Serving☆11Updated 6 years ago
- Predict age & gender in one model☆19Updated 7 years ago
- Unofficial Pytorch implementation of BlazeFace☆42Updated 5 years ago
- 介绍ctc算法原理以及numpy简单实现☆61Updated 5 years ago
- A flexible Python front-end inference SDK based on TensorRT☆86Updated 4 years ago
- A tensorflow2 implementation of EfficientNet.☆31Updated 5 years ago
- A breakdown of NCNN☆46Updated 4 years ago
- ☆30Updated 5 years ago
- ☆34Updated 6 years ago
- Real time face landmarking using decision trees and NN autoencoders☆70Updated 6 years ago
- thxx: libtorch C++ API extentions and examples☆46Updated 6 years ago
- PyTorch 1.0 inference in C++ on Windows10 platforms☆89Updated 6 years ago
- TensorFlow and Pytorch practice codes with purity and simplicity.☆34Updated 5 years ago
- A mxnet object detection library contains implementations of RFCN, FCOS, RetinaNet, OpenPose, etc..☆31Updated 4 years ago