Alternatives and similar repositories for trtserver-go

Users that are interested in trtserver-go are comparing it to the libraries listed below

• orktes / go-torch
  LibTorch (PyTorch) bindings for Golang
  ☆273Updated 4 years ago
• sunhailin-Leo / triton-service-go
  Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
  ☆50Updated this week
• rai-project / go-tensorrt
  Go binding to TensorRT C API to do inference with pre-trained model in Go
  ☆30Updated 5 years ago
• sugarme / gotch
  Go binding for Pytorch C++ API (libtorch)
  ☆627Updated 7 months ago
• juandes / tensorflow-go-models
  A collection of models for TensorFlow Go
  ☆12Updated 3 years ago
• NVIDIA / go-tfdata
  Go library that provides easy-to-use interfaces and tools for TensorFlow users, in particular allowing to train existing TF models on .ta…
  ☆16Updated last year
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆138Updated last month
• levipereira / triton-client-yolo
  This repository utilizes the Triton Inference Server Client, which streamlines the complexity of model deployment.
  ☆21Updated last year
• c3sr / go-onnxruntime
  ☆26Updated 3 years ago
• Curt-Park / mnist-fastapi-aio-triton
  Simple example of FastAPI + gRPC AsyncIO + Triton
  ☆67Updated 3 years ago
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆157Updated 2 weeks ago
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆33Updated 3 years ago
• milvus-io / milvus-insight
  Milvus management GUI
  ☆97Updated 3 years ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• prabhuomkar / bitbeast
  Experiments with Model Training, Deployment & Monitoring
  ☆39Updated 2 months ago
• buckhx / gobert
  Go Bindings for BERT NLP Models
  ☆105Updated 6 years ago
• Stability-AI / stability-sdk-go
  Golang functions for interacting with Stability API
  ☆27Updated last year
• DataIntelligenceCrew / go-faiss
  Go bindings for Faiss
  ☆95Updated last year
• osai-ai / dokai
  Collection of Docker images for ML/DL and video processing projects
  ☆109Updated 10 months ago
• jat001 / gotorch
  PyTorch in Go, using LibTorch.
  ☆15Updated 6 years ago
• FrancescoSaverioZuppichini / dynamic-batching-asyncio
  ☆32Updated 2 years ago
• triton-inference-server / stateful_backend
  Triton backend for managing the model state tensors automatically in sequence batcher
  ☆18Updated last year
• louisoutin / yolov5_torchserve
  Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time in…
  ☆100Updated 2 years ago
• wamuir / golang-tf
  Working golang + tensorflow
  ☆23Updated 3 years ago
• ivansuteja96 / go-onnxruntime
  Unofficial C binding for Onnxruntime in Golang.
  ☆19Updated 8 months ago
• LdDl / goparking
  This project is targeted to detect which parking lot (actually any user defined polygon) are occupied by any object.
  ☆11Updated 7 years ago
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆287Updated 3 years ago
• Peter-Chou / libtorch_grpc_serving
  pytorch during training, libtorch during serving via gRPC
  ☆21Updated 6 years ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆29Updated 2 years ago
• levipereira / triton-server-yolo
  This repository serves as an example of deploying the YOLO models on Triton Server for performance and testing purposes
  ☆69Updated last year