sunhailin-Leo / triton-service-goLinks
Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
☆50Updated 2 weeks ago
Alternatives and similar repositories for triton-service-go
Users that are interested in triton-service-go are comparing it to the libraries listed below
Sorting:
- Go bindings for Tiktoken & HuggingFace Tokenizer☆197Updated 2 months ago
- LibTorch (PyTorch) bindings for Golang☆276Updated 4 years ago
- A Go idiomatic binding to the C++ core of PyTorch☆358Updated 2 years ago
- Go bindings for Faiss☆99Updated last year
- NLP tokenizers written in Go language☆305Updated 2 months ago
- Go binding for Pytorch C++ API (libtorch)☆639Updated 11 months ago
- NLP transformers written in Go☆253Updated 2 years ago
- Inference Llama 2 in Go☆39Updated 2 years ago
- Go Bindings for BERT NLP Models☆107Updated 6 years ago
- LLaMA-2 in native Go☆194Updated last year
- Go Bindings for the NVIDIA Management Library (NVML)☆419Updated 2 months ago
- Go binding to TensorRT C API to do inference with pre-trained model in Go☆31Updated 5 years ago
- Llama 2 inference in one file of pure Go☆110Updated 2 years ago
- onnx-go gives the ability to import a pre-trained neural network within Go without being linked to a framework or library.☆869Updated last year
- Binding to transformers in ggml☆64Updated 2 weeks ago
- Common source, scripts and utilities shared across all Triton repositories.☆79Updated 2 weeks ago
- A Go (golang) library wrapping microsoft/onnxruntime.☆520Updated 2 weeks ago
- Go language bindings for ONNX runtime☆18Updated 5 years ago
- The Triton backend for the ONNX Runtime.☆172Updated last week
- Go framework for DL model inference and API deployment☆51Updated last year
- XGBoost inference with Golang.☆34Updated 2 years ago
- Go implementation of today's most used tokenizers☆44Updated 5 years ago
- Inference Llama 2 in one file of pure go☆16Updated 2 years ago
- 🚀 Building Go applications with LLMs through composability☆117Updated last year
- ZenModel is a framework for building LLM applications with agentic workflow☆74Updated last year
- Go library for loading Python's data serialized with pickle and PyTorch module files.☆154Updated last year
- ONNX / GoMLX Conversion☆47Updated this week
- Run ONNX models using Go☆82Updated 9 months ago
- A highly optimized double-ended queue☆203Updated 2 years ago
- 【Go DAG Schedule Framework】A simple way to build a pipeline with Go.☆50Updated 5 months ago