Alternatives and similar repositories for tritonserver-rs:

Users that are interested in tritonserver-rs are comparing it to the libraries listed below

• oddity-ai / async-tensorrt
  Asynchronous TensorRT for Rust.
  ☆24Updated 5 months ago
• evgenyigumnov / candle-simplified-example
  A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.
  ☆38Updated last year
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆142Updated this week
• ssoudan / tch-m1
  Example of tch-rs on M1
  ☆53Updated last year
• Narsil / bindgen_cuda
  ☆23Updated this week
• mstallmo / tensorrt-rs
  Rust library for running TensorRT accelerated deep learning models
  ☆55Updated 3 years ago
• Gordon01 / rust-interview
  ☆22Updated 2 years ago
• huggingface / hf-hub
  Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package
  ☆196Updated last month
• igor-yusupov / rusty-yolo
  ☆13Updated last year
• thewh1teagle / sherpa-rs
  Rust bindings to https://github.com/k2-fsa/sherpa-onnx
  ☆160Updated 3 weeks ago
• robertknight / rten
  ONNX neural network inference engine
  ☆199Updated last week
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆21Updated last month
• Gadersd / whisper-burn
  A Rust implementation of OpenAI's Whisper model using the burn framework
  ☆301Updated 11 months ago
• danielclough / fireside-chat
  An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…
  ☆132Updated 6 months ago
• tomsanbear / candle-einops
  ☆28Updated 5 months ago
• lasantosr / model-mapper
  Derive macro to map between different types
  ☆24Updated 3 months ago
• Gadersd / llama2-burn
  Llama2 LLM ported to Rust burn
  ☆276Updated last year
• elftausend / custos
  A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.
  ☆73Updated last month
• alttch / busrt
  BUS/RT - Modern, fast, Rust-native IPC broker
  ☆119Updated this week
• gnp / minbpe-rs
  Port of Andrej Karpathy's minbpe to Rust
  ☆22Updated 11 months ago
• igumnoff / gabriel2
  Gabriel2: Indeed, an actor library based on Tokio, written in Rust
  ☆27Updated 9 months ago
• oddity-ai / async-cuda
  Asynchronous CUDA for Rust.
  ☆32Updated 5 months ago
• kribrum-os / morph-rs
  Морфология русского языка на Rust.
  ☆16Updated 11 months ago
• boncheolgu / tflite-rs
  ☆125Updated 9 months ago
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆39Updated last year
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆34Updated 5 months ago
• chenwanqq / candle-llava
  implement llava using candle
  ☆14Updated 10 months ago
• masc-it / yolov5-api-rust
  Rust API to run predictions with YoloV5 models.
  ☆28Updated 2 years ago
• nbigaouette / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
  ☆290Updated last year
• gaxler / llama2.rs
  Inference Llama 2 in one file of pure Rust 🦀
  ☆233Updated last year