miguelvr / trtserver-goLinks
Serving a PyTorch model with Triton Inference Server and GoLang
☆24Updated 5 years ago
Alternatives and similar repositories for trtserver-go
Users that are interested in trtserver-go are comparing it to the libraries listed below
Sorting:
- Go binding to TensorRT C API to do inference with pre-trained model in Go☆31Updated 5 years ago
- Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)☆50Updated 2 weeks ago
- A collection of models for TensorFlow Go☆12Updated 3 years ago
- Common source, scripts and utilities shared across all Triton repositories.☆79Updated 2 weeks ago
- ☆26Updated 3 years ago
- Go Bindings for BERT NLP Models☆107Updated 6 years ago
- A Go idiomatic binding to the C++ core of PyTorch☆358Updated 2 years ago
- ClearML - Model-Serving Orchestration and Repository Solution☆161Updated 3 weeks ago
- Tools and libraries for using Tensorflow (and Tensorflow Serving) in go☆31Updated 4 years ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆215Updated 9 months ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆667Updated this week
- Collection of Docker images for ML/DL and video processing projects☆111Updated last year
- ☆15Updated 5 years ago
- cgo interface to WebRTC Voice Activity Dectection☆67Updated 5 years ago
- Examples of using TensorFlow Go API for different Deep Learning models☆22Updated 6 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆140Updated this week
- Go bindings for Faiss☆99Updated last year
- Working golang + tensorflow☆23Updated 3 years ago
- Go library that provides easy-to-use interfaces and tools for TensorFlow users, in particular allowing to train existing TF models on .ta…☆17Updated last year
- ☆163Updated 2 years ago
- Manipulate audio in a simple and elegant way.☆40Updated 2 years ago
- Unofficial C binding for Onnxruntime in Golang.☆21Updated 2 months ago
- Minimal HLS streaming demo with dynamic marker support in Python☆28Updated 2 years ago
- pytorch during training, libtorch during serving via gRPC☆21Updated 6 years ago
- Real-time object detection with Go and Tensorflow☆64Updated 7 years ago
- ODAM - Object detection and Monitoring☆37Updated 2 years ago
- hnswlib golang interface☆22Updated last year
- This repository utilizes the Triton Inference Server Client, which streamlines the complexity of model deployment.☆21Updated last year
- Go Bindings for cudnn and other cuda pacakges.☆31Updated 5 years ago
- NLP transformers written in Go☆253Updated 2 years ago