oddity-ai / async-tensorrtLinks
Asynchronous TensorRT for Rust.
☆32Updated 2 weeks ago
Alternatives and similar repositories for async-tensorrt
Users that are interested in async-tensorrt are comparing it to the libraries listed below
Sorting:
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.☆186Updated 3 weeks ago
- Rust bindings for OpenVINO™☆101Updated last month
- Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.☆80Updated 3 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆74Updated 3 weeks ago
- ☆90Updated 6 months ago
- ONNX neural network inference engine☆221Updated this week
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆303Updated last year
- Models and examples built with Burn☆263Updated last month
- Asynchronous CUDA for Rust.☆34Updated 8 months ago
- ☆23Updated 3 months ago
- Example of tch-rs on M1☆54Updated last year
- ☆13Updated last year
- Low rank adaptation (LoRA) for Candle.☆152Updated 3 months ago
- Rust high performace utilities for YUV format handling and conversion.☆89Updated 3 weeks ago
- Derive macro to map between different types☆28Updated 6 months ago
- YOLOv5 Inference with ONNX & OpenCV in Rust☆14Updated last year
- Rustic bindings to the IREE Compiler/Runtime☆21Updated 2 months ago
- SciRS2 - Scientific Computing and AI in Rust☆44Updated last week
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆108Updated 2 years ago
- Type conversion among popular Rust computer vision libraries☆49Updated 2 months ago
- A Rust wrapper for Darknet, an open source neural network framework written in C and CUDA.☆34Updated 2 years ago
- A neural network inference library, written in Rust.☆63Updated last year
- Rust audio/video engine☆98Updated 3 months ago
- Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.☆77Updated last month
- Kiddo☆127Updated last week
- audio/video toolkit based FFmpeg 6.x, 7.x supported for multimedia with Hardware Acceleration.☆37Updated last week
- A fun, hackable, GPU-accelerated, neural network library in Rust, written by an idiot☆133Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆219Updated last month
- Llama2 LLM ported to Rust burn☆280Updated last year