triton-inference-server / stateful_backend

Related projects ⓘ

Alternatives and complementary repositories for stateful_backend

• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆133Updated this week
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆52Updated last year
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated last year
• triton-inference-server / redis_cache
  TRITONCACHE implementation of a Redis cache
  ☆12Updated this week
• Prem-kumar27 / Fast-KTSpeechCrawler
  Parallelized automatic corpus collection for ASR. Forked from https://github.com/EgorLakomkin/KTSpeechCrawler
  ☆23Updated 3 years ago
• belkov0912 / faiss4java
  参考faiss4j，已经废弃，采用c版本rpc通信的形式
  ☆12Updated 2 years ago
• louiezzang / faiss-server
  Faiss server for efficient similarity search and clustering of dense vectors
  ☆23Updated 2 years ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆14Updated last year
• raman-r-4978 / JFaiss-CPU
  Faiss bindings for Java
  ☆22Updated 4 years ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆62Updated this week
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year
• coqui-ai / inference-engine
  Coqui Inference Engine
  ☆38Updated 3 years ago
• mjansche / openfst
  Read-only unofficial mirror of OpenFst
  ☆43Updated 2 years ago
• jermp / autocomplete
  Efficient and effective query auto-completion in C++.
  ☆51Updated last year
• ant-louis / xm-retrievers
  🌏 Modular retrievers for zero-shot multilingual IR.
  ☆27Updated 8 months ago
• sdpython / onnxcustom
  Tutorial on how to convert machine learned models into ONNX
  ☆15Updated last year
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆51Updated this week
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆185Updated 2 months ago
• huggingface / tune
  ☆86Updated 2 years ago
• marekgalovic / anndb
  Distributed Approximate Nearest Neighbors Database https://anndb.com
  ☆35Updated 3 years ago
• jermp / tongrams
  A C++ library providing fast language model queries in compressed space.
  ☆128Updated last year
• google-research / mozolm
  MozoLM: A language model (LM) serving library
  ☆44Updated 3 weeks ago
• frozentoad9 / CMST
  Prabhupadavani: A Code-mixed Speech Translation Data for 25 languages
  ☆13Updated 2 years ago
• philschmid / optimum-transformers-optimizations
  ☆30Updated 2 years ago
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆30Updated 2 years ago
• NVIDIA / speechsquad
  Conversational AI Benchmark.
  ☆65Updated last year
• jplu / faiss-grpc-server
  gRPC server over a FAISS index
  ☆17Updated 3 years ago
• amogkam / batch-inference-benchmarks
  ☆15Updated last year
• daanzu / wav2vec2_stt_python
  Simple Python library, distributed via binary wheels with few direct dependencies, for easily using wav2vec 2.0 models for speech recogni…
  ☆24Updated 3 years ago