Alternatives and similar repositories for async-tensorrt

Users that are interested in async-tensorrt are comparing it to the libraries listed below

• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆40Updated last year
• intel / openvino-rs
  Rust bindings for OpenVINO™
  ☆111Updated 4 months ago
• jordandelbar / yolo-tonic
  Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.
  ☆87Updated 2 weeks ago
• sarah-quinones / gemm
  ☆97Updated last month
• Narsil / bindgen_cuda
  ☆30Updated 8 months ago
• elftausend / custos
  A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.
  ☆77Updated 4 months ago
• jerry73204 / rust-cv-convert
  Type conversion among popular Rust computer vision libraries
  ☆54Updated 7 months ago
• oddity-ai / async-cuda
  Asynchronous CUDA for Rust.
  ☆36Updated 3 months ago
• tracel-ai / models
  Models and examples built with Burn
  ☆320Updated last month
• nbigaouette / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
  ☆317Updated last year
• jamjamjon / usls
  A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, an…
  ☆293Updated last week
• alianse777 / darknet-rust
  A Rust wrapper for Darknet, an open source neural network framework written in C and CUDA.
  ☆34Updated 2 years ago
• boncheolgu / tflite-rs
  ☆128Updated last year
• Nonanti / mathcore
  Symbolic math library and computer algebra system for Rust
  ☆88Updated 3 weeks ago
• KarelPeeters / Kyanite
  A neural network inference library, written in Rust.
  ☆70Updated last year
• tjardoo / openai-client
  OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.
  ☆76Updated last week
• awxkee / yuvutils-rs
  Rust high performace utilities for YUV format handling and conversion.
  ☆108Updated last month
• iddm / thread-priority
  A simple Cross-platform thread schedule and priority library for rust.
  ☆142Updated 3 months ago
• wyfo / arc-slice
  Utilities for working with shared slices of memory
  ☆82Updated 6 months ago
• pan93412 / yolo-rs
  A high-level Rust implementation of the YOLO v11 object detection model.
  ☆63Updated last week
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆168Updated 8 months ago
• valebes / ppl
  Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.
  ☆78Updated 3 months ago
• cool-japan / scirs
  SciRS2 - Scientific Computing and AI in Rust
  ☆109Updated last week
• lasantosr / model-mapper
  Derive macro to map between different types
  ☆29Updated 11 months ago
• robertknight / rten
  ONNX neural network inference engine
  ☆270Updated last week
• udoprog / leaky-bucket
  A token-based rate limiter based on the leaky bucket algorithm.
  ☆113Updated 2 months ago
• rmitsuboshi / miniboosts
  A collection of boosting algorithms written in Rust 🦀
  ☆57Updated 7 months ago
• ShelbyJenkins / llm_utils
  llm_utils: Basic LLM tools, best practices, and minimal abstraction.
  ☆47Updated 10 months ago
• evgenyigumnov / candle-simplified-example
  A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.
  ☆39Updated 2 years ago
• oddity-ai / rave
  Rust audio/video engine
  ☆118Updated 8 months ago