Alternatives and similar repositories for tritonserver-rs:

Users that are interested in tritonserver-rs are comparing it to the libraries listed below

• mstallmo / tensorrt-rs
  Rust library for running TensorRT accelerated deep learning models
  ☆53Updated 3 years ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆144Updated 7 months ago
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆21Updated 2 weeks ago
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆34Updated 4 months ago
• Narsil / bindgen_cuda
  ☆21Updated 8 months ago
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆38Updated last year
• oddity-ai / async-tensorrt
  Asynchronous TensorRT for Rust.
  ☆24Updated 4 months ago
• oddity-ai / async-cuda
  Asynchronous CUDA for Rust.
  ☆31Updated 4 months ago
• tomsanbear / candle-einops
  ☆28Updated 4 months ago
• boncheolgu / tflite-rs
  ☆124Updated 9 months ago
• robertknight / rten
  ONNX neural network inference engine
  ☆193Updated this week
• tracel-ai / models
  Models and examples built with Burn
  ☆226Updated 3 weeks ago
• gnp / minbpe-rs
  Port of Andrej Karpathy's minbpe to Rust
  ☆22Updated 10 months ago
• jeroenvlek / gpt-from-scratch-rs
  Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle
  ☆72Updated last year
• haixuanTao / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)
  ☆24Updated 2 years ago
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆104Updated last year
• nbigaouette / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
  ☆289Updated last year
• huggingface / hf-hub
  Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package
  ☆190Updated last month
• thewh1teagle / sherpa-rs
  Rust bindings to https://github.com/k2-fsa/sherpa-onnx
  ☆139Updated last week
• masc-it / yolov5-api-rust
  Rust API to run predictions with YoloV5 models.
  ☆28Updated 2 years ago
• elftausend / custos
  A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.
  ☆73Updated last week
• sarah-quinones / gemm
  ☆85Updated 2 months ago
• intel / openvino-rs
  Rust bindings for OpenVINO™
  ☆89Updated last week
• LaurentMazare / ug
  Experimental compiler for deep learning models
  ☆29Updated last month
• lasantosr / model-mapper
  Derive macro to map between different types
  ☆23Updated 2 months ago
• octoml / triton-client-rs
  A client library in Rust for Nvidia Triton.
  ☆28Updated last year
• kaegi / webrtc-vad
  Rust interface for the WebRTC Voice-Activity-Module
  ☆28Updated 4 years ago
• MathisWellmann / gym-rs
  OpenAI's Gym written in pure Rust for blazingly fast performance
  ☆95Updated 5 months ago
• kribrum-os / morph-rs
  Морфология русского языка на Rust.
  ☆16Updated 11 months ago
• guillaume-be / rust-tokenizers
  Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…
  ☆304Updated last year