oddity-ai / async-tensorrtLinks
Asynchronous TensorRT for Rust.
☆34Updated last month
Alternatives and similar repositories for async-tensorrt
Users that are interested in async-tensorrt are comparing it to the libraries listed below
Sorting:
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.☆197Updated last week
- Rust bindings for OpenVINO™☆103Updated last month
- Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.☆81Updated 4 months ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆75Updated 3 weeks ago
- Asynchronous CUDA for Rust.☆35Updated 10 months ago
- ☆92Updated 8 months ago
- Models and examples built with Burn☆282Updated last week
- Rust high performace utilities for YUV format handling and conversion.☆91Updated last week
- Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.☆77Updated this week
- ONNX neural network inference engine☆233Updated this week
- An async actor framework for Rust☆55Updated last week
- Dead simple implementation of Discrete Kalman filter for object tracking purposes☆16Updated this week
- A neural network inference library, written in Rust.☆65Updated last year
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆307Updated last year
- A lockless mpmc/mpsc to support async base on crossbeam☆133Updated this week
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆39Updated last year
- Type conversion among popular Rust computer vision libraries☆51Updated 3 months ago
- Rust audio/video engine☆100Updated 4 months ago
- Low rank adaptation (LoRA) for Candle.☆158Updated 4 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Updated 6 months ago
- A collection of boosting algorithms written in Rust 🦀☆57Updated 3 months ago
- Example of tch-rs on M1☆54Updated last year
- Toy NN LIB☆23Updated 6 months ago
- A very fast HTTP Server based on Hyper and Rust☆87Updated last year
- ☆24Updated 4 months ago
- A multi-producer multi-consumer queue implementation based on Tokio☆42Updated 3 months ago
- Rust API to run predictions with YoloV5 models.☆28Updated 3 years ago
- ☆13Updated last year
- Remoc 🦑 — Remote multiplexed objects, channels and RPC for Rust☆203Updated this week