Alternatives and similar repositories for async-tensorrt:

Users that are interested in async-tensorrt are comparing it to the libraries listed below

• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆39Updated last year
• oddity-ai / async-cuda
  Asynchronous CUDA for Rust.
  ☆32Updated 6 months ago
• intel / openvino-rs
  Rust bindings for OpenVINO™
  ☆90Updated last month
• jamjamjon / usls
  A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.
  ☆133Updated last week
• sarah-quinones / gemm
  ☆85Updated 3 months ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆145Updated 2 weeks ago
• jordandelbar / yolo-tonic
  Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.
  ☆75Updated this week
• igor-yusupov / rusty-yolo
  ☆13Updated last year
• jerry73204 / rust-cv-convert
  Type conversion among popular Rust computer vision libraries
  ☆47Updated 8 months ago
• elftausend / custos
  A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.
  ☆73Updated last month
• awxkee / yuvutils-rs
  Rust high performace utilities for YUV format handling and conversion.
  ☆80Updated this week
• KarelPeeters / Kyanite
  A neural network inference library, written in Rust.
  ☆61Updated 9 months ago
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆34Updated last week
• rust-cv / nshare
  Provides an interface layer to convert between n-dimensional types in different Rust crates
  ☆54Updated 8 months ago
• rust-cv / ndarray-vision
  Computer vision library built on top of ndarray
  ☆69Updated 7 months ago
• danielclough / fireside-chat
  An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…
  ☆133Updated 6 months ago
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆46Updated last month
• workflow-rs / workflow-rs
  Rust application development framework for native and web applications
  ☆61Updated 2 months ago
• sdd / kiddo
  Kiddo
  ☆120Updated last month
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆22Updated last month
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆104Updated last year
• bencevans / rust-opencv-yolov5
  YOLOv5 Inference with ONNX & OpenCV in Rust
  ☆14Updated last year
• robohouse-delft / show-image-rs
  Quickly show images for debugging in Rust.
  ☆41Updated last month
• mstallmo / tensorrt-rs
  Rust library for running TensorRT accelerated deep learning models
  ☆56Updated 3 years ago
• evgenyigumnov / candle-simplified-example
  A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.
  ☆38Updated last year
• rmitsuboshi / miniboosts
  A collection of boosting algorithms written in Rust 🦀
  ☆53Updated 3 months ago
• gmmyung / eerie
  Rustic bindings to the IREE Compiler/Runtime
  ☆18Updated 2 weeks ago
• VasanthakumarV / einops
  Simplistic API for deep learning tensor operations
  ☆28Updated last week
• valebes / ppl
  Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.
  ☆76Updated 3 weeks ago
• tracel-ai / models
  Models and examples built with Burn
  ☆234Updated 2 weeks ago