Alternatives and similar repositories for trtserver-go

Users that are interested in trtserver-go are comparing it to the libraries listed below

• orktes / go-torch
  LibTorch (PyTorch) bindings for Golang
  ☆271Updated 4 years ago
• rai-project / go-tensorrt
  Go binding to TensorRT C API to do inference with pre-trained model in Go
  ☆30Updated 5 years ago
• sunhailin-Leo / triton-service-go
  Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
  ☆50Updated this week
• juandes / tensorflow-go-models
  A collection of models for TensorFlow Go
  ☆12Updated 3 years ago
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆156Updated 2 months ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆211Updated 5 months ago
• triton-inference-server / python_backend
  Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
  ☆642Updated last week
• c3sr / go-onnxruntime
  ☆26Updated 3 years ago
• ivansuteja96 / go-onnxruntime
  Unofficial C binding for Onnxruntime in Golang.
  ☆19Updated 7 months ago
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆138Updated 2 weeks ago
• osai-ai / dokai
  Collection of Docker images for ML/DL and video processing projects
  ☆109Updated 9 months ago
• levipereira / triton-client-yolo
  This repository utilizes the Triton Inference Server Client, which streamlines the complexity of model deployment.
  ☆21Updated last year
• triton-inference-server / client
  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
  ☆647Updated 2 weeks ago
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆33Updated 3 years ago
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆490Updated 2 weeks ago
• NVIDIA / go-tfdata
  Go library that provides easy-to-use interfaces and tools for TensorFlow users, in particular allowing to train existing TF models on .ta…
  ☆16Updated last year
• buckhx / gobert
  Go Bindings for BERT NLP Models
  ☆106Updated 6 years ago
• triton-inference-server / pytriton
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆821Updated last month
• triton-inference-server / stateful_backend
  Triton backend for managing the model state tensors automatically in sequence batcher
  ☆18Updated last year
• LdDl / odam
  ODAM - Object detection and Monitoring
  ☆36Updated 2 years ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• louisoutin / yolov5_torchserve
  Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time in…
  ☆100Updated 2 years ago
• google / tensorflow-recorder
  TFRecorder makes it easy to create TensorFlow records (TFRecords) from Pandas DataFrames and CSVs files containing images or structured d…
  ☆180Updated 3 years ago
• pbridger / pytorch-video-pipeline
  ☆115Updated 4 years ago
• pbridger / deepstream-video-pipeline
  ☆115Updated 4 years ago
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆97Updated 11 months ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆29Updated 2 years ago
• dhdanie / goonnx
  Go language bindings for ONNX runtime
  ☆18Updated 5 years ago
• notAI-tech / fastDeploy
  Deploy DL/ ML inference pipelines with minimal extra code.
  ☆99Updated 10 months ago
• DataIntelligenceCrew / go-faiss
  Go bindings for Faiss
  ☆95Updated last year