Alternatives and similar repositories for async-tensorrt:

Users that are interested in async-tensorrt are comparing it to the libraries listed below

• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆37Updated 10 months ago
• oddity-ai / async-cuda
  Asynchronous CUDA for Rust.
  ☆27Updated 2 months ago
• awxkee / yuvutils-rs
  Rust high performace utilities for YUV format handling and conversion.
  ☆61Updated this week
• intel / openvino-rs
  Rust bindings for OpenVINO™
  ☆86Updated last month
• igor-yusupov / rusty-yolo
  ☆13Updated last year
• Narsil / bindgen_cuda
  ☆20Updated 6 months ago
• AndreyGermanov / yolov8_onnx_rust
  YOLOv8 inference using Rust
  ☆60Updated 11 months ago
• elftausend / custos
  A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.
  ☆71Updated last month
• ShelbyJenkins / llm_utils
  llm_utils: Basic LLM tools, best practices, and minimal abstraction.
  ☆41Updated 3 months ago
• TuckerBMorgan / poro
  Toy NN LIB
  ☆20Updated 2 weeks ago
• mstallmo / tensorrt-rs
  Rust library for running TensorRT accelerated deep learning models
  ☆51Updated 3 years ago
• sarah-quinones / gemm
  ☆77Updated last week
• han-minhee / yolo-rust-ort
  Rust implementation of Ultralytics YOLOv8/v10 using ONNX (ort)
  ☆23Updated 3 weeks ago
• lasantosr / model-mapper
  Derive macro to map between different types
  ☆22Updated 4 months ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆134Updated 4 months ago
• webrtc-rs / ortc
  ORTC in Rust with Sans-IO
  ☆24Updated last month
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆41Updated last week
• sdroege / rtsp-types
  RTSP (RFC 7826) types and parsers/serializers
  ☆25Updated 4 months ago
• ssoudan / tch-m1
  Example of tch-rs on M1
  ☆51Updated 10 months ago
• strawlab / cam-geom
  📷 📐 Geometric models of cameras for photogrammetry
  ☆46Updated 2 weeks ago
• ahirner / infur
  image segmentation on video and images
  ☆45Updated last year
• robertknight / rten
  ONNX neural network inference engine
  ☆143Updated this week
• plabayo / tokio-graceful
  Graceful shutdown util for Rust projects using the Tokio Async runtime.
  ☆126Updated 3 months ago
• bencevans / rust-opencv-yolov5
  YOLOv5 Inference with ONNX & OpenCV in Rust
  ☆14Updated last year
• w0xel / sync_cow
  Thread-safe clone-on-write container for fast concurrent writing and reading.
  ☆49Updated 2 years ago
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆102Updated last year
• rust-cv / nshare
  Provides an interface layer to convert between n-dimensional types in different Rust crates
  ☆49Updated 4 months ago
• jamjamjon / usls
  A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.
  ☆70Updated this week
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆64Updated last week
• vishpat / candle-coursera-ml
  Implementation of the Coursera ML course in Rust
  ☆32Updated this week