Alternatives and similar repositories for async-tensorrt:

Users that are interested in async-tensorrt are comparing it to the libraries listed below

• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆38Updated last year
• oddity-ai / async-cuda
  Asynchronous CUDA for Rust.
  ☆32Updated 5 months ago
• jamjamjon / usls
  A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.
  ☆122Updated this week
• elftausend / custos
  A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.
  ☆73Updated 3 weeks ago
• igor-yusupov / rusty-yolo
  ☆13Updated last year
• jordandelbar / yolo-tonic
  Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.
  ☆72Updated this week
• lasantosr / model-mapper
  Derive macro to map between different types
  ☆23Updated 2 months ago
• awxkee / yuvutils-rs
  Rust high performace utilities for YUV format handling and conversion.
  ☆79Updated this week
• ssoudan / tch-m1
  Example of tch-rs on M1
  ☆53Updated last year
• Narsil / bindgen_cuda
  ☆22Updated 9 months ago
• TuckerBMorgan / poro
  Toy NN LIB
  ☆22Updated last month
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆46Updated last month
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆144Updated 7 months ago
• oddity-ai / rave
  Rust audio/video engine
  ☆91Updated last year
• KarelPeeters / Kyanite
  A neural network inference library, written in Rust.
  ☆61Updated 9 months ago
• han-minhee / yolo-rust-ort
  Rust implementation of Ultralytics YOLOv8/v10 using ONNX (ort)
  ☆29Updated this week
• robohouse-delft / show-image-rs
  Quickly show images for debugging in Rust.
  ☆41Updated last month
• sarah-quinones / gemm
  ☆85Updated 3 months ago
• evgenyigumnov / candle-simplified-example
  A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.
  ☆38Updated last year
• intel / openvino-rs
  Rust bindings for OpenVINO™
  ☆88Updated 3 weeks ago
• jonefeewang / stonemq
  A high-performance and efficient message queue developed in Rust
  ☆74Updated last month
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆34Updated 4 months ago
• jerry73204 / rust-cv-convert
  Type conversion among popular Rust computer vision libraries
  ☆47Updated 8 months ago
• mstallmo / tensorrt-rs
  Rust library for running TensorRT accelerated deep learning models
  ☆54Updated 3 years ago
• EricLBuehler / trc
  A faster Arc.
  ☆60Updated last year
• danielclough / fireside-chat
  An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…
  ☆132Updated 6 months ago
• LdDl / kalman-rs
  Dead simple implementation of Discrete Kalman filter for object tracking purposes
  ☆15Updated last year
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆21Updated last month
• tpoisonooo / rust-ncnn
  ncnn Rust API.
  ☆43Updated last year
• rmitsuboshi / miniboosts
  A collection of boosting algorithms written in Rust 🦀
  ☆52Updated 2 months ago