rai-project / go-tensorrt
Go binding to TensorRT C API to do inference with pre-trained model in Go
☆27Updated 4 years ago
Related projects: ⓘ
- Go language bindings for ONNX runtime☆18Updated 4 years ago
- Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)☆41Updated last week
- LibTorch (PyTorch) bindings for Golang☆249Updated 3 years ago
- pytorch during training, libtorch during serving via gRPC☆21Updated 5 years ago
- PyTorch in Go, using LibTorch.☆15Updated 5 years ago
- ☆15Updated 4 years ago
- Go binding for TensorFlow Lite☆299Updated 3 months ago
- Minimal example of using a traced huggingface transformers model with libtorch