mstallmo / tensorrt-rsLinks
Rust library for running TensorRT accelerated deep learning models
☆56Updated 3 years ago
Alternatives and similar repositories for tensorrt-rs
Users that are interested in tensorrt-rs are comparing it to the libraries listed below
Sorting:
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆301Updated last year
- A machine learning library for Rust.☆326Updated 10 months ago
- Rust bindings for OpenVINO™☆99Updated 3 weeks ago
- ☆127Updated last year
- ☆23Updated 3 months ago
- A framework for building high-performance real-time multiple object trackers☆240Updated 3 months ago
- ☆27Updated last year
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆23Updated 3 years ago
- Computer vision library built on top of ndarray☆70Updated 9 months ago
- Low rank adaptation (LoRA) for Candle.☆151Updated 2 months ago
- ☆89Updated 6 months ago
- Computational graphs with reverse automatic differentation in the GPU☆392Updated 2 years ago
- Llama2 LLM ported to Rust burn☆280Updated last year
- A Rust implementation of OpenAI's Whisper model using the burn framework☆318Updated last year
- Models and examples built with Burn☆253Updated 3 weeks ago
- ☆30Updated 7 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆107Updated last year
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆74Updated this week
- A collection of optimisers for use with candle☆36Updated last month
- Rust matrix multiplication benchmarks☆20Updated 2 years ago
- 🦀 Low-level 3D Computer Vision library in Rust☆375Updated this week
- Example of tch-rs on M1☆54Updated last year
- Rust language bindings for Faiss☆219Updated 4 months ago
- A Rust Library for High-Performance Tensor Exchange with Python☆47Updated last week
- Sample Python extension using Rust/PyO3/tch to interact with PyTorch☆37Updated last year
- Experimentation using the xla compiler from rust☆95Updated 10 months ago
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated last year
- PyTorch GStreamer elements in Rust for Computer Vision and Deep Learning☆36Updated 2 years ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- 🦀 Example of serving deep learning models in Rust with batched prediction☆34Updated 2 years ago