oddity-ai / async-tensorrtLinks
Asynchronous TensorRT for Rust.
☆37Updated 2 months ago
Alternatives and similar repositories for async-tensorrt
Users that are interested in async-tensorrt are comparing it to the libraries listed below
Sorting:
- Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.☆84Updated 6 months ago
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, an…☆224Updated last week
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- Rust bindings for OpenVINO™☆108Updated 3 months ago
- Asynchronous CUDA for Rust.☆36Updated 2 months ago
- ☆26Updated 7 months ago
- SciRS2 - Scientific Computing and AI in Rust☆86Updated last week
- A high-level Rust implementation of the YOLO v11 object detection model.☆54Updated 2 weeks ago
- ☆94Updated 10 months ago
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆311Updated last year
- ONNX neural network inference engine☆257Updated this week
- Rust high performace utilities for YUV format handling and conversion.☆101Updated last month
- Models and examples built with Burn☆302Updated last week
- Type conversion among popular Rust computer vision libraries☆53Updated 5 months ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆75Updated 2 months ago
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆39Updated 2 years ago
- An async actor framework for Rust☆59Updated last month
- Dead simple implementation of Discrete Kalman filter for object tracking purposes☆16Updated 2 weeks ago
- Low rank adaptation (LoRA) for Candle.☆166Updated 7 months ago
- ☆13Updated 2 years ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Updated 9 months ago
- Derive macro to map between different types☆28Updated 9 months ago
- Provides an interface layer to convert between n-dimensional types in different Rust crates☆55Updated last year
- Democratizing large model inference and training on any device.☆167Updated 2 weeks ago
- Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.☆78Updated 2 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆76Updated last year
- A collection of optimisers for use with candle☆43Updated 3 months ago
- Async broadcast channels☆187Updated 2 months ago
- Kiddo☆139Updated 2 weeks ago
- Rust implementation of Ultralytics YOLOv8/v10 using ONNX (ort)☆39Updated 7 months ago