mstallmo / tensorrt-rsLinks
Rust library for running TensorRT accelerated deep learning models
☆64Updated 4 years ago
Alternatives and similar repositories for tensorrt-rs
Users that are interested in tensorrt-rs are comparing it to the libraries listed below
Sorting:
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆317Updated last year
- ☆128Updated last year
- A machine learning library for Rust.☆332Updated last year
- Rust bindings for OpenVINO™☆112Updated 4 months ago
- Models and examples built with Burn☆323Updated last month
- A framework for building high-performance real-time multiple object trackers☆255Updated 9 months ago
- Low rank adaptation (LoRA) for Candle.☆169Updated 8 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- ☆31Updated this week
- ☆38Updated last year
- A collection of optimisers for use with candle☆45Updated this week
- Computer vision library built on top of ndarray☆71Updated last year
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 3 years ago
- Rust language bindings for Faiss☆243Updated last month
- Asynchronous TensorRT for Rust.☆40Updated 3 months ago
- Llama2 LLM ported to Rust burn☆279Updated last year
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆111Updated 2 years ago
- Inference Llama 2 in one file of pure Rust 🦀☆235Updated 2 years ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆336Updated last year
- PyTorch GStreamer elements in Rust for Computer Vision and Deep Learning☆37Updated 3 years ago
- Computational graphs with reverse automatic differentation in the GPU☆397Updated 3 years ago
- Example of tch-rs on M1☆55Updated last year
- ☆97Updated last month
- GPU based FFT written in Rust and CubeCL☆27Updated this week
- Your one stop CLI for ONNX model analysis.☆47Updated 3 years ago
- A Rust implementation of OpenAI's Whisper model using the burn framework☆335Updated last year
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆77Updated 4 months ago
- Asynchronous CUDA for Rust.☆36Updated 3 months ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆250Updated 3 weeks ago
- ONNX neural network inference engine☆270Updated this week