miguelvr / trtserver-goLinks
Serving a PyTorch model with Triton Inference Server and GoLang
☆24Updated 5 years ago
Alternatives and similar repositories for trtserver-go
Users that are interested in trtserver-go are comparing it to the libraries listed below
Sorting:
- LibTorch (PyTorch) bindings for Golang☆276Updated 4 years ago
- Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)☆50Updated last week
- Go binding to TensorRT C API to do inference with pre-trained model in Go☆31Updated 5 years ago
- Go binding for Pytorch C++ API (libtorch)☆633Updated 9 months ago
- A collection of models for TensorFlow Go☆12Updated 3 years ago
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆663Updated 2 weeks ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆829Updated 3 months ago
- This repository utilizes the Triton Inference Server Client, which streamlines the complexity of model deployment.☆21Updated last year
- Go bindings for Faiss☆98Updated last year
- ClearML - Model-Serving Orchestration and Repository Solution☆158Updated 3 weeks ago
- Go Bindings for BERT NLP Models☆108Updated 6 years ago
- Go language bindings for ONNX runtime☆18Updated 5 years ago
- Go library that provides easy-to-use interfaces and tools for TensorFlow users, in particular allowing to train existing TF models on .ta…☆16Updated last year
- ☆33Updated 3 years ago
- The Triton backend for TensorRT.☆79Updated 2 weeks ago
- A Go (golang) library wrapping microsoft/onnxruntime.☆446Updated last month
- NLP transformers written in Go☆249Updated 2 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆139Updated 2 weeks ago
- ☆26Updated 3 years ago
- Deploy and scale machine learning models with FastAPI, Redis and Docker☆151Updated 3 years ago
- Collection of Docker images for ML/DL and video processing projects☆110Updated last year
- Plugin for deploying MLflow models to TorchServe☆110Updated 2 years ago
- Working golang + tensorflow☆23Updated 3 years ago
- Convert ONNX models to PyTorch.☆710Updated last month
- PyTorch in Go, using LibTorch.☆15Updated 6 years ago
- Accelerate PyTorch models with ONNX Runtime☆367Updated 9 months ago
- Article about deploying machine learning models using grpc, pytorch and asyncio☆30Updated 3 years ago
- Go library for loading Python's data serialized with pickle and PyTorch module files.☆152Updated last year
- pytorch during training, libtorch during serving via gRPC☆21Updated 6 years ago
- Examples for using ONNX Runtime for model training.☆357Updated last year