miguelvr / trtserver-goLinks
Serving a PyTorch model with Triton Inference Server and GoLang
☆24Updated 5 years ago
Alternatives and similar repositories for trtserver-go
Users that are interested in trtserver-go are comparing it to the libraries listed below
Sorting:
- LibTorch (PyTorch) bindings for Golang☆267Updated 4 years ago
- Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)☆50Updated last week
- Go binding for Pytorch C++ API (libtorch)☆627Updated 6 months ago
- A collection of models for TensorFlow Go☆12Updated 3 years ago
- Go binding to TensorRT C API to do inference with pre-trained model in Go☆30Updated 5 years ago
- A Go idiomatic binding to the C++ core of PyTorch☆349Updated 2 years ago
- PyTorch in Go, using LibTorch.☆15Updated 6 years ago
- Go language bindings for ONNX runtime☆18Updated 5 years ago
- ☆26Updated 3 years ago
- onnx-go gives the ability to import a pre-trained neural network within Go without being linked to a framework or library.☆824Updated last year
- ClearML - Model-Serving Orchestration and Repository Solution☆155Updated last month
- A Go (golang) library wrapping microsoft/onnxruntime.☆371Updated last month
- Go Bindings for BERT NLP Models☆105Updated 6 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆137Updated last week
- Go bindings for Faiss☆93Updated last year
- Go library that provides easy-to-use interfaces and tools for TensorFlow users, in particular allowing to train existing TF models on .ta…☆16Updated last year
- Collection of Docker images for ML/DL and video processing projects☆109Updated 9 months ago
- Simple example of FastAPI + gRPC AsyncIO + Triton☆67Updated 3 years ago
- Example applications using the onnxruntime_go library.☆27Updated last month
- hnswlib golang interface☆21Updated 8 months ago
- Golang functions for interacting with Stability API☆27Updated 10 months ago
- This repository utilizes the Triton Inference Server Client, which streamlines the complexity of model deployment.☆20Updated last year
- ODAM - Object detection and Monitoring☆35Updated 2 years ago
- Tools and libraries for using Tensorflow (and Tensorflow Serving) in go☆30Updated 4 years ago
- This repository serves as an example of deploying the YOLO models on Triton Server for performance and testing purposes☆67Updated last year
- Working golang + tensorflow☆23Updated 3 years ago
- NLP transformers written in Go☆239Updated 2 years ago
- Unofficial C binding for Onnxruntime in Golang.☆19Updated 7 months ago
- tflitego provide a simple and clear solution to use TensorFlow lite in Go. Our objective is provide a cohesive API, simplicity related t…☆17Updated 4 years ago
- This is a repo with a Triton Server deployment template☆24Updated last year