sunhailin-Leo / triton-service-go
Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
☆41Updated last week
Related projects: ⓘ
- A Go idiomatic binding to the C++ core of PyTorch☆312Updated last year
- LibTorch (PyTorch) bindings for Golang☆249Updated 3 years ago
- Go bindings for HuggingFace Tokenizer☆81Updated last month
- A Go (golang) library wrapping microsoft/onnxruntime.☆171Updated this week
- The Triton backend for the ONNX Runtime.☆122Updated this week
- Go bindings for Faiss☆71Updated last month
- Go binding to TensorRT C API to do inference with pre-trained model in Go☆27Updated 4 years ago
- Common source, scripts and utilities shared across all Triton repositories.☆62Updated 2 weeks ago
- NLP tokenizers written in Go language☆167Updated 3 months ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆178Updated last week
- Common source, scripts and utilities for creating Triton backends.☆280Updated 2 weeks ago
- GoMLX: An Accelerated Machine Learning Framework For Go☆259Updated this week
- ☆170Updated this week
- ☆32Updated 7 months ago
- The core library and APIs implementing the Triton Inference Server.☆101Updated this week
- NLP transformers written in Go☆204Updated last year
- ☆49Updated last year
- onnx-go gives the ability to import a pre-trained neural network within Go without being linked to a framework or library.☆683Updated 2 weeks ago
- The Triton backend for TensorRT.☆59Updated last week
- Binding to transformers in ggml☆58Updated last week
- OpenVINO backend for Triton.☆29Updated 2 weeks ago
- Go language bindings for ONNX runtime☆18Updated 4 years ago
- Go Bindings for BERT NLP Models☆99Updated 5 years ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆419Updated 2 weeks ago
- Go binding for Pytorch C++ API (libtorch)☆560Updated 7 months ago
- This is a go library for faiss☆27Updated 3 years ago
- Serving a PyTorch model with Triton Inference Server and GoLang☆23Updated 4 years ago
- Triton backend for managing the model state tensors automatically in sequence batcher☆13Updated 7 months ago
- The Triton backend for TensorFlow.☆44Updated last week
- Inference Llama 2 in Go☆36Updated last year