miguelvr / trtserver-go

Related projects: ⓘ

• sunhailin-Leo / triton-service-go
  Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
  ☆41Updated last week
• orktes / go-torch
  LibTorch (PyTorch) bindings for Golang
  ☆249Updated 3 years ago
• c3sr / go-onnxruntime
  ☆26Updated 2 years ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆178Updated last week
• rai-project / go-tensorrt
  Go binding to TensorRT C API to do inference with pre-trained model in Go
  ☆27Updated 4 years ago
• wangkuiyi / gotorch
  A Go idiomatic binding to the C++ core of PyTorch
  ☆312Updated last year
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆122Updated this week
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆59Updated last week
• gotorch-dev / gotorch
  PyTorch in Go, using LibTorch.
  ☆15Updated 5 years ago
• ivansuteja96 / go-onnxruntime
  Unofficial C binding for Onnxruntime in Golang.
  ☆15Updated 10 months ago
• dhdanie / goonnx
  Go language bindings for ONNX runtime
  ☆18Updated 4 years ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆62Updated 2 weeks ago
• kamalkraj / stable-diffusion-tritonserver
  Deploy stable diffusion model with onnx/tenorrt + tritonserver
  ☆119Updated last year
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆122Updated last week
• triton-inference-server / python_backend
  Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
  ☆523Updated this week
• Peter-Chou / libtorch_grpc_serving
  pytorch during training, libtorch during serving via gRPC
  ☆21Updated 5 years ago
• DataIntelligenceCrew / go-faiss
  Go bindings for Faiss
  ☆71Updated last month
• buckhx / gobert
  Go Bindings for BERT NLP Models
  ☆99Updated 5 years ago
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆280Updated 2 weeks ago
• triton-inference-server / tensorflow_backend
  The Triton backend for TensorFlow.
  ☆44Updated last week
• sugarme / gotch
  Go binding for Pytorch C++ API (libtorch)
  ☆560Updated 7 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆117Updated last week
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆106Updated last year
• juandes / tensorflow-go-models
  A collection of models for TensorFlow Go
  ☆12Updated 2 years ago
• Applifier / go-tensorflow
  Tools and libraries for using Tensorflow (and Tensorflow Serving) in go
  ☆30Updated 3 years ago
• allegroai / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆137Updated last month
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆29Updated 2 years ago
• triton-inference-server / client
  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
  ☆547Updated this week
• aws / amazon-s3-plugin-for-pytorch
  ☆168Updated last year
• nlpodyssey / gopickle
  Go library for loading Python's data serialized with pickle and PyTorch module files.
  ☆132Updated last month