mstallmo / tensorrt-rsLinks
Rust library for running TensorRT accelerated deep learning models
☆62Updated 4 years ago
Alternatives and similar repositories for tensorrt-rs
Users that are interested in tensorrt-rs are comparing it to the libraries listed below
Sorting:
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆312Updated last year
- A machine learning library for Rust.☆332Updated last year
- ☆128Updated last year
- Rust bindings for OpenVINO™☆108Updated 3 months ago
- A framework for building high-performance real-time multiple object trackers☆252Updated 7 months ago
- Models and examples built with Burn☆305Updated 2 weeks ago
- Low rank adaptation (LoRA) for Candle.☆168Updated 7 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆110Updated 2 years ago
- ☆95Updated last week
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- Rust language bindings for Faiss☆240Updated last week
- 🦀 Low-level 3D Computer Vision library in Rust☆478Updated this week
- ☆36Updated last year
- ☆28Updated 2 years ago
- Llama2 LLM ported to Rust burn☆278Updated last year
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 3 years ago
- ☆26Updated 7 months ago
- Computer vision library built on top of ndarray☆71Updated last year
- A Rust Library for High-Performance Tensor Exchange with Python☆48Updated last week
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated 2 years ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆76Updated 3 months ago
- Computational graphs with reverse automatic differentation in the GPU☆396Updated 3 years ago
- Example of tch-rs on M1☆55Updated last year
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆76Updated last year
- General matrix multiplication of f32 and f64 matrices in Rust. Supports matrices with general strides.☆242Updated 6 months ago
- PyTorch GStreamer elements in Rust for Computer Vision and Deep Learning☆37Updated 3 years ago
- Dataflow is a data processing library, primarily for machine learning.☆24Updated 2 years ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆328Updated last year
- Rust crate for easy and efficient ML model inference☆29Updated 4 months ago
- A Rust implementation of OpenAI's Whisper model using the burn framework☆329Updated last year