sunhailin-Leo / triton-service-goLinks
Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
☆50Updated this week
Alternatives and similar repositories for triton-service-go
Users that are interested in triton-service-go are comparing it to the libraries listed below
Sorting:
- A Go idiomatic binding to the C++ core of PyTorch☆349Updated 2 years ago
- Go bindings for Tiktoken & HuggingFace Tokenizer☆163Updated last month
- LibTorch (PyTorch) bindings for Golang☆267Updated 4 years ago
- Common source, scripts and utilities shared across all Triton repositories.☆76Updated 3 weeks ago
- Go binding for Pytorch C++ API (libtorch)☆627Updated 6 months ago
- NLP tokenizers written in Go language☆266Updated 3 weeks ago
- The Triton backend for the ONNX Runtime.☆159Updated this week
- Common source, scripts and utilities for creating Triton backends.☆345Updated 3 weeks ago
- Go Bindings for the NVIDIA Management Library (NVML)☆396Updated last week
- onnx-go gives the ability to import a pre-trained neural network within Go without being linked to a framework or library.☆819Updated last year
- A Go (golang) library wrapping microsoft/onnxruntime.☆367Updated last month
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆210Updated 4 months ago
- NLP transformers written in Go☆239Updated 2 years ago
- ☆291Updated 3 weeks ago
- Go bindings for Faiss☆92Updated last year
- Golang bindings for Nvidia Datacenter GPU Manager (DCGM)☆130Updated last week
- Binding to transformers in ggml☆63Updated this week
- Go framework for DL model inference and API deployment☆50Updated 8 months ago
- The core library and APIs implementing the Triton Inference Server.☆147Updated 3 weeks ago
- LLaMA-2 in native Go☆194Updated 9 months ago
- Go binding to TensorRT C API to do inference with pre-trained model in Go☆30Updated 5 years ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆484Updated 3 weeks ago
- Inference Llama 2 in Go☆39Updated 2 years ago
- The Triton backend for TensorFlow.☆53Updated 2 months ago
- The Triton backend for TensorRT.☆78Updated 3 weeks ago
- Go language bindings for ONNX runtime☆18Updated 5 years ago
- ☆412Updated last year
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆415Updated this week
- ☆104Updated this week
- Inference Llama 2 in one file of pure go☆16Updated 2 years ago