sunhailin-Leo / triton-service-goLinks
Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
☆50Updated 2 weeks ago
Alternatives and similar repositories for triton-service-go
Users that are interested in triton-service-go are comparing it to the libraries listed below
Sorting:
- Go bindings for Tiktoken & HuggingFace Tokenizer☆183Updated last month
- A Go idiomatic binding to the C++ core of PyTorch☆351Updated 2 years ago
- LibTorch (PyTorch) bindings for Golang☆273Updated 4 years ago
- Go binding for Pytorch C++ API (libtorch)☆630Updated 8 months ago
- NLP tokenizers written in Go language☆282Updated last month
- Go bindings for Faiss☆95Updated last year
- Common source, scripts and utilities shared across all Triton repositories.☆77Updated this week
- NLP transformers written in Go☆247Updated 2 years ago
- onnx-go gives the ability to import a pre-trained neural network within Go without being linked to a framework or library.☆849Updated last year
- Binding to transformers in ggml☆64Updated last week
- The Triton backend for the ONNX Runtime.☆163Updated this week
- A Go (golang) library wrapping microsoft/onnxruntime.☆412Updated 2 weeks ago
- LLaMA-2 in native Go☆194Updated 11 months ago
- Go Bindings for the NVIDIA Management Library (NVML)☆407Updated last month
- Inference Llama 2 in Go☆39Updated 2 years ago
- Go framework for DL model inference and API deployment☆50Updated 10 months ago
- Llama 2 inference in one file of pure Go☆107Updated 2 years ago
- Go Bindings for BERT NLP Models☆108Updated 6 years ago
- Common source, scripts and utilities for creating Triton backends.☆354Updated this week
- Golang bindings for Nvidia Datacenter GPU Manager (DCGM)☆138Updated 2 weeks ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆213Updated 6 months ago
- The core library and APIs implementing the Triton Inference Server.☆155Updated this week
- 【Go DAG Schedule Framework】A simple way to build a pipeline with Go.☆49Updated 2 months ago
- 🚀 Building Go applications with LLMs through composability☆117Updated last year
- Golang Client for Jina (https://github.com/jina-ai/jina)☆20Updated last year
- ONNX / GoMLX Conversion☆36Updated 2 weeks ago
- Run ONNX models using Go☆78Updated 7 months ago
- ZenModel is a framework for building LLM applications with agentic workflow☆74Updated last year
- [mirror] Open source contributor agent architecture repo.☆207Updated last month
- XGBoost inference with Golang.☆31Updated 2 years ago