sunhailin-Leo / triton-service-go
Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
☆46Updated 2 weeks ago
Alternatives and similar repositories for triton-service-go:
Users that are interested in triton-service-go are comparing it to the libraries listed below
- Go bindings for HuggingFace Tokenizer☆134Updated 3 weeks ago
- NLP tokenizers written in Go language☆229Updated 4 months ago
- Go bindings for Faiss☆81Updated 8 months ago
- The core library and APIs implementing the Triton Inference Server.☆124Updated last week
- Go framework for DL model inference and API deployment☆50Updated 4 months ago
- Go Bindings for BERT NLP Models☆104Updated 5 years ago
- The Triton backend for the ONNX Runtime.☆140Updated last week
- A Go idiomatic binding to the C++ core of PyTorch☆338Updated last year
- LibTorch (PyTorch) bindings for Golang☆262Updated 4 years ago
- A Go (golang) library wrapping microsoft/onnxruntime.☆291Updated 3 weeks ago
- Common source, scripts and utilities for creating Triton backends.☆316Updated last week
- Triton backend for managing the model state tensors automatically in sequence batcher☆17Updated last year
- Go binding for Pytorch C++ API (libtorch)☆610Updated last month
- NLP transformers written in Go☆229Updated 2 years ago
- Common source, scripts and utilities shared across all Triton repositories.☆69Updated last week
- Binding to transformers in ggml☆61Updated 2 weeks ago
- ☆246Updated last week
- Go language bindings for ONNX runtime☆18Updated 5 years ago
- Go binding to TensorRT C API to do inference with pre-trained model in Go☆29Updated 4 years ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆199Updated 3 months ago
- Golang bindings for Nvidia Datacenter GPU Manager (DCGM)☆109Updated 3 weeks ago
- ☆26Updated 2 years ago
- Inference Llama 2 in one file of pure go☆16Updated last year
- ZenModel is a framework for building LLM applications with agentic workflow☆66Updated 6 months ago
- Inference Llama 2 in Go☆39Updated last year
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆619Updated this week
- Go implementation of today's most used tokenizers☆42Updated 4 years ago
- The Triton backend for TensorRT.☆73Updated this week
- Go Bindings for the NVIDIA Management Library (NVML)☆358Updated this week
- hnswlib golang interface☆20Updated 4 months ago