Alternatives and similar repositories for async-tensorrt

Users that are interested in async-tensorrt are comparing it to the libraries listed below

• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆40Updated last year
• jamjamjon / usls
  A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, an…
  ☆249Updated this week
• jordandelbar / yolo-tonic
  Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.
  ☆87Updated this week
• intel / openvino-rs
  Rust bindings for OpenVINO™
  ☆109Updated 3 months ago
• oddity-ai / async-cuda
  Asynchronous CUDA for Rust.
  ☆36Updated 2 months ago
• elftausend / custos
  A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.
  ☆76Updated 3 months ago
• Narsil / bindgen_cuda
  ☆26Updated 7 months ago
• tracel-ai / models
  Models and examples built with Burn
  ☆315Updated last month
• nbigaouette / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
  ☆315Updated last year
• masc-it / yolov5-api-rust
  Rust API to run predictions with YoloV5 models.
  ☆27Updated 3 years ago
• sarah-quinones / gemm
  ☆96Updated 3 weeks ago
• awxkee / yuvutils-rs
  Rust high performace utilities for YUV format handling and conversion.
  ☆104Updated last week
• cwahn / theta
  An async actor framework for Rust
  ☆59Updated 2 months ago
• robertknight / rten
  ONNX neural network inference engine
  ☆261Updated this week
• cool-japan / scirs
  SciRS2 - Scientific Computing and AI in Rust
  ☆100Updated this week
• pan93412 / yolo-rs
  A high-level Rust implementation of the YOLO v11 object detection model.
  ☆59Updated last week
• jerry73204 / rust-cv-convert
  Type conversion among popular Rust computer vision libraries
  ☆53Updated 6 months ago
• robohouse-delft / show-image-rs
  Quickly show images for debugging in Rust.
  ☆42Updated 9 months ago
• igor-yusupov / rusty-yolo
  ☆13Updated 2 years ago
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆44Updated this week
• KarelPeeters / Kyanite
  A neural network inference library, written in Rust.
  ☆70Updated last year
• zk4x / zyx
  Tensor library for machine learning
  ☆26Updated this week
• valebes / ppl
  Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.
  ☆78Updated 3 months ago
• alianse777 / darknet-rust
  A Rust wrapper for Darknet, an open source neural network framework written in C and CUDA.
  ☆34Updated 2 years ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆168Updated 7 months ago
• chelsea0x3b / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆110Updated 2 years ago
• lasantosr / model-mapper
  Derive macro to map between different types
  ☆29Updated 10 months ago
• kurtschelfthout / tensorken
  A fun, hackable, GPU-accelerated, neural network library in Rust, written by an idiot
  ☆134Updated last year
• rust-cv / nshare
  Provides an interface layer to convert between n-dimensional types in different Rust crates
  ☆56Updated last year
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆61Updated last week