miguelvr / trtserver-go
Serving a PyTorch model with Triton Inference Server and GoLang
☆23Updated 4 years ago
Alternatives and similar repositories for trtserver-go:
Users that are interested in trtserver-go are comparing it to the libraries listed below
- Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)☆46Updated this week
- LibTorch (PyTorch) bindings for Golang☆262Updated 4 years ago
- Go binding to TensorRT C API to do inference with pre-trained model in Go☆29Updated 4 years ago
- Go language bindings for ONNX runtime☆18Updated 5 years ago
- Unofficial C binding for Onnxruntime in Golang.☆18Updated 2 months ago
- Go library that provides easy-to-use interfaces and tools for TensorFlow users, in particular allowing to train existing TF models on .ta…☆15Updated last year
- ☆26Updated 2 years ago
- Go Bindings for BERT NLP Models☆104Updated 5 years ago
- Go bindings for Faiss☆81Updated 8 months ago
- Tools and libraries for using Tensorflow (and Tensorflow Serving) in go☆31Updated 4 years ago
- A collection of models for TensorFlow Go☆12Updated 2 years ago
- ClearML - Model-Serving Orchestration and Repository Solution☆149Updated 3 months ago
- ☆15Updated 4 years ago
- PyTorch in Go, using LibTorch.☆15Updated 5 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆132Updated this week
- pytorch during training, libtorch during serving via gRPC☆21Updated 5 years ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆199Updated this week
- hnswlib golang interface☆20Updated 4 months ago
- A Go (golang) library wrapping microsoft/onnxruntime.☆291Updated last month
- cgo interface to WebRTC Voice Activity Dectection☆52Updated 4 years ago
- Collection of Docker images for ML/DL and video processing projects☆106Updated 5 months ago
- Golang functions for interacting with Stability API☆27Updated 6 months ago
- Common source, scripts and utilities for creating Triton backends.☆318Updated this week
- The Triton backend for the ONNX Runtime.☆142Updated this week
- Streaming machine learning using PyTorch, Flink, and ONNX☆25Updated 3 years ago
- Management Dashboard for Torchserve☆120Updated 2 years ago
- Clone a voice in 5 seconds to generate arbitrary speech in real-time☆34Updated 4 years ago
- ☆115Updated 4 years ago
- Example applications using the onnxruntime_go library.☆24Updated 5 months ago
- Common source, scripts and utilities shared across all Triton repositories.☆70Updated last week