mstallmo / tensorrt-rsLinks
Rust library for running TensorRT accelerated deep learning models
☆57Updated 3 years ago
Alternatives and similar repositories for tensorrt-rs
Users that are interested in tensorrt-rs are comparing it to the libraries listed below
Sorting:
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆305Updated last year
- A machine learning library for Rust.☆328Updated last year
- ☆128Updated last year
- Rust bindings for OpenVINO™☆102Updated last week
- Low rank adaptation (LoRA) for Candle.☆154Updated 4 months ago
- ☆24Updated 4 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- Models and examples built with Burn☆276Updated 3 weeks ago
- Example of tch-rs on M1☆54Updated last year
- ☆90Updated 7 months ago
- Llama2 LLM ported to Rust burn☆280Updated last year
- Computer vision library built on top of ndarray☆70Updated 10 months ago
- Dataflow is a data processing library, primarily for machine learning.☆24Updated 2 years ago
- Rust language bindings for Faiss☆228Updated 5 months ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆221Updated 2 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆108Updated 2 years ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆74Updated last year
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆311Updated last year
- Asynchronous TensorRT for Rust.☆33Updated 2 weeks ago
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 3 years ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆75Updated this week
- A framework for building high-performance real-time multiple object trackers☆243Updated 5 months ago
- ☆33Updated 9 months ago
- A collection of optimisers for use with candle☆39Updated 2 weeks ago
- Half-precision floating point types f16 and bf16 for Rust.☆258Updated 2 months ago
- 🦀 Low-level 3D Computer Vision library in Rust☆405Updated this week
- A fun, hackable, GPU-accelerated, neural network library in Rust, written by an idiot☆133Updated last year
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆323Updated last year
- General matrix multiplication of f32 and f64 matrices in Rust. Supports matrices with general strides.☆241Updated 3 months ago
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated last year