oddity-ai / async-tensorrtLinks
Asynchronous TensorRT for Rust.
☆40Updated 4 months ago
Alternatives and similar repositories for async-tensorrt
Users that are interested in async-tensorrt are comparing it to the libraries listed below
Sorting:
- Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.☆88Updated last month
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- Rust bindings for OpenVINO™☆115Updated last month
- ☆97Updated 2 months ago
- Asynchronous CUDA for Rust.☆37Updated 4 months ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆77Updated 5 months ago
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆319Updated last year
- Models and examples built with Burn☆335Updated last week
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆40Updated 2 years ago
- ☆33Updated 2 weeks ago
- ONNX neural network inference engine☆282Updated 3 weeks ago
- A high-level Rust implementation of the YOLO v11 object detection model.☆68Updated this week
- Kiddo☆153Updated this week
- Provides an interface layer to convert between n-dimensional types in different Rust crates☆56Updated last year
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, an…☆346Updated this week
- A neural network inference library, written in Rust.☆68Updated last year
- Sans-IO WebRTC implementation in Rust☆92Updated last week
- Example of tch-rs on M1☆55Updated last year
- Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.☆79Updated 5 months ago
- Llama2 LLM ported to Rust burn☆279Updated last year
- Dead simple implementation of Discrete Kalman filter for object tracking purposes☆16Updated last month
- Quickly show images for debugging in Rust.☆43Updated 10 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆48Updated 11 months ago
- Rust high performace utilities for YUV format handling and conversion.☆109Updated last week
- Low rank adaptation (LoRA) for Candle.☆169Updated 9 months ago
- A framework for building high-performance real-time multiple object trackers☆256Updated 10 months ago
- An async actor framework for Rust☆60Updated 4 months ago
- A collection of boosting algorithms written in Rust 🦀☆57Updated 8 months ago
- Rust audio/video engine☆122Updated 9 months ago
- Democratizing large model inference and training on any device.☆193Updated 3 weeks ago