Alternatives and similar repositories for trtserver-go:

Users that are interested in trtserver-go are comparing it to the libraries listed below

• sunhailin-Leo / triton-service-go
  Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
  ☆45Updated this week
• rai-project / go-tensorrt
  Go binding to TensorRT C API to do inference with pre-trained model in Go
  ☆28Updated 4 years ago
• orktes / go-torch
  LibTorch (PyTorch) bindings for Golang
  ☆255Updated 3 years ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆193Updated 2 weeks ago
• juandes / tensorflow-go-models
  A collection of models for TensorFlow Go
  ☆12Updated 2 years ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆68Updated this week
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆132Updated 2 weeks ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆67Updated 2 weeks ago
• c3sr / go-onnxruntime
  ☆26Updated 2 years ago
• PINTO0309 / whisper-onnx-tensorrt
  ONNX and TensorRT implementation of Whisper
  ☆61Updated last year
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆136Updated this week
• buckhx / gobert
  Go Bindings for BERT NLP Models
  ☆101Updated 5 years ago
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆96Updated 3 months ago
• levipereira / triton-client-yolo
  This repository utilizes the Triton Inference Server Client, which streamlines the complexity of model deployment.
  ☆14Updated 4 months ago
• dhdanie / goonnx
  Go language bindings for ONNX runtime
  ☆18Updated 4 years ago
• pbridger / pytorch-video-pipeline
  ☆114Updated 4 years ago
• k9ele7en / Triton-TensorRT-Inference-CRAFT-pytorch
  Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…
  ☆32Updated 3 years ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆107Updated last year
• tulasiram58827 / craft_tflite
  This is the github repository for converting craft pretrained model to tflite version
  ☆33Updated 3 years ago
• pbridger / deepstream-video-pipeline
  ☆115Updated 4 years ago
• kamalkraj / stable-diffusion-tritonserver
  Deploy stable diffusion model with onnx/tenorrt + tritonserver
  ☆122Updated last year
• BlueMirrors / cvu
  Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platform…
  ☆88Updated last year
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆141Updated 2 weeks ago
• MegaMosquito / slipstream
  A simple Python example that uses Deepstream to process a video stream.
  ☆35Updated 3 years ago
• levipereira / triton-server-yolo
  This repository serves as an example of deploying the YOLO models on Triton Server for performance and testing purposes
  ☆52Updated 8 months ago
• Applifier / go-tensorflow
  Tools and libraries for using Tensorflow (and Tensorflow Serving) in go
  ☆30Updated 3 years ago
• notAI-tech / fastDeploy
  Deploy DL/ ML inference pipelines with minimal extra code.
  ☆96Updated 2 months ago
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆306Updated 2 weeks ago
• DataIntelligenceCrew / go-faiss
  Go bindings for Faiss
  ☆78Updated 5 months ago
• triton-inference-server / paddlepaddle_backend
  ☆32Updated 11 months ago