sunhailin-Leo / triton-service-go
Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
☆46Updated this week
Alternatives and similar repositories for triton-service-go:
Users that are interested in triton-service-go are comparing it to the libraries listed below
- Go bindings for HuggingFace Tokenizer☆126Updated this week
- LibTorch (PyTorch) bindings for Golang☆261Updated 3 years ago
- Go framework for DL model inference and API deployment☆50Updated 3 months ago
- The Triton backend for the ONNX Runtime.☆140Updated 2 weeks ago
- NLP tokenizers written in Go language☆224Updated 3 months ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆199Updated 2 months ago
- Common source, scripts and utilities shared across all Triton repositories.☆69Updated this week
- ZenModel is a framework for building LLM applications with agentic workflow☆66Updated 5 months ago
- A Go (golang) library wrapping microsoft/onnxruntime.☆274Updated this week
- Binding to transformers in ggml☆60Updated last week
- A Go idiomatic binding to the C++ core of PyTorch☆336Updated last year
- The core library and APIs implementing the Triton Inference Server.☆123Updated this week
- Inference Llama 2 in Go☆39Updated last year
- Go bindings for Faiss☆80Updated 7 months ago
- Go implementation of today's most used tokenizers☆41Updated 4 years ago
- LLaMA-2 in native Go☆192Updated 3 months ago
- Go language bindings for ONNX runtime☆18Updated 4 years ago
- Run ONNX models using Go☆63Updated last month
- ☆238Updated last week
- Go Bindings for BERT NLP Models☆103Updated 5 years ago
- Go SDK for Milvus(Deprecated)☆374Updated last week
- Common source, scripts and utilities for creating Triton backends.☆311Updated this week
- NLP transformers written in Go☆227Updated 2 years ago
- Inference Llama 2 in one file of pure go☆16Updated last year
- Triton backend for managing the model state tensors automatically in sequence batcher☆15Updated last year
- hnswlib golang interface☆20Updated 3 months ago
- Example applications using the onnxruntime_go library.☆21Updated 4 months ago
- Golang Client for Jina (https://github.com/jina-ai/jina)☆19Updated last year
- Llama 2 inference in one file of pure Go☆104Updated last year
- 【Go DAG Schedule Framework】A simple way to build a pipeline with Go.☆40Updated last week