rai-project / go-tensorrt
Go binding to TensorRT C API to do inference with pre-trained model in Go
☆29Updated 4 years ago
Alternatives and similar repositories for go-tensorrt:
Users that are interested in go-tensorrt are comparing it to the libraries listed below
- Go language bindings for ONNX runtime☆18Updated 5 years ago
- LibTorch (PyTorch) bindings for Golang☆262Updated 4 years ago
- Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)☆46Updated this week
- pytorch during training, libtorch during serving via gRPC☆21Updated 5 years ago
- Unofficial C binding for Onnxruntime in Golang.☆18Updated 2 months ago
- Real-time object detection with Go and Tensorflow☆63Updated 6 years ago
- A collection of models for TensorFlow Go☆12Updated 2 years ago
- ☆26Updated 2 years ago
- ☆15Updated 4 years ago
- PyTorch in Go, using LibTorch.☆15Updated 5 years ago
- Go binding for TensorFlow Lite☆310Updated 10 months ago
- Serving a PyTorch model with Triton Inference Server and GoLang☆23Updated 4 years ago
- Golang binding for YOLO/Darknet recognition framework☆76Updated 7 years ago
- cgo interface to WebRTC Voice Activity Dectection☆52Updated 4 years ago
- Face Detector based on MTCNN, tensorflow and golang☆120Updated 2 years ago
- Tools and libraries for using Tensorflow (and Tensorflow Serving) in go☆31Updated 4 years ago
- Guide to deploying deep-learning inference networks and deep vision primitives on Sophon TPU.☆35Updated last year
- Whisper in TensorRT-LLM☆15Updated last year
- Go implementation of Arcface inference☆19Updated last year
- Common source, scripts and utilities shared across all Triton repositories.☆70Updated last week
- ☆65Updated 2 years ago
- Go bindings for Darknet (YOLO v4 / v7-tiny / v3)☆83Updated 2 years ago
- This repo is based on https://github.com/jeetkanjani7/Parallel_NMS but add PyCUDA implementation☆9Updated 6 years ago
- A Toolkit to Help Optimize Onnx Model☆140Updated last week
- Retinaface get 80.99% in widerface hard val using mobilenet0.25.☆24Updated 4 years ago
- ☆33Updated last year
- The Triton backend for TensorRT.☆73Updated this week
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆132Updated this week
- Go Bindings for BERT NLP Models☆104Updated 5 years ago
- The Triton backend for the ONNX Runtime.☆142Updated this week