rai-project / go-tensorrt
Go binding to TensorRT C API to do inference with pre-trained model in Go
☆28Updated 4 years ago
Alternatives and similar repositories for go-tensorrt:
Users that are interested in go-tensorrt are comparing it to the libraries listed below
- Go language bindings for ONNX runtime☆18Updated 4 years ago
- LibTorch (PyTorch) bindings for Golang☆255Updated 3 years ago
- Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)☆45Updated this week
- Go bindings for Darknet (YOLO v4 / v7-tiny / v3)☆83Updated 2 years ago
- PyTorch in Go, using LibTorch.☆15Updated 5 years ago
- Tools and libraries for using Tensorflow (and Tensorflow Serving) in go☆30Updated 3 years ago
- pytorch during training, libtorch during serving via gRPC☆21Updated 5 years ago
- Golang binding for YOLO/Darknet recognition framework☆76Updated 6 years ago
- Minimal example of using a traced huggingface transformers model with libtorch☆35Updated 4 years ago
- Real-time object detection with Go and Tensorflow☆62Updated 6 years ago
- ☆32Updated 11 months ago
- Go Bindings for BERT NLP Models☆101Updated 5 years ago
- A Toolkit to Help Optimize Onnx Model☆102Updated this week
- A Go idiomatic binding to the C++ core of PyTorch☆329Updated last year
- ODAM - Object detection and Monitoring☆32Updated last year
- Go binding for TensorFlow Lite☆307Updated 7 months ago
- ☆15Updated 4 years ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆279Updated 2 years ago
- cgo interface to WebRTC Voice Activity Dectection☆50Updated 3 years ago
- ☆26Updated 2 years ago
- demos for https://github.com/notedit/gst☆18Updated 2 years ago
- ☆27Updated 5 years ago
- This repo is based on https://github.com/jeetkanjani7/Parallel_NMS but add PyCUDA implementation☆9Updated 6 years ago
- Face Detector based on MTCNN, tensorflow and golang☆120Updated 2 years ago
- The Triton backend for the ONNX Runtime.☆136Updated this week
- Decode JPEG image on GPU using PyTorch☆84Updated last year
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆131Updated this week
- Guide to deploying deep-learning inference networks and deep vision primitives on Sophon TPU.☆35Updated last year
- A pytorch to tensorrt convert with dynamic shape support☆258Updated 11 months ago
- Triton Inferece Server Model Config and Client Scripts☆31Updated 3 years ago