mstallmo / tensorrt-rs
Rust library for running TensorRT accelerated deep learning models
☆52Updated 3 years ago
Alternatives and similar repositories for tensorrt-rs:
Users that are interested in tensorrt-rs are comparing it to the libraries listed below
- ☆123Updated 8 months ago
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆289Updated last year
- Computer vision library built on top of ndarray☆68Updated 5 months ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆74Updated 2 months ago
- Rust bindings for OpenVINO™☆88Updated last month
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆38Updated 11 months ago
- ☆83Updated 2 months ago
- A machine learning library for Rust.☆323Updated 6 months ago
- Rust binding to CUDA APIs☆119Updated 2 years ago
- Llama2 LLM ported to Rust burn☆277Updated 10 months ago
- ☆28Updated 3 months ago
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 2 years ago
- Asynchronous TensorRT for Rust.☆23Updated 4 months ago
- k-dimensional tree☆82Updated 10 months ago
- Low rank adaptation (LoRA) for Candle.☆144Updated 6 months ago
- General matrix multiplication of f32 and f64 matrices in Rust. Supports matrices with general strides.☆227Updated 7 months ago
- ☆25Updated last year
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆104Updated last year
- A collection of optimisers for use with candle☆34Updated 3 months ago
- Half-precision floating point types f16 and bf16 for Rust.☆239Updated 9 months ago
- ☆21Updated 8 months ago
- Example of tch-rs on M1☆53Updated 11 months ago
- Asynchronous CUDA for Rust.☆30Updated 4 months ago
- Experimentation using the xla compiler from rust☆90Updated 6 months ago
- Hidden Markov Models in Rust☆70Updated 11 months ago
- Enzyme integration into Rust. Experimental, do not use.☆102Updated 2 years ago
- A framework for building high-performance real-time multiple object trackers☆219Updated this week
- Type conversion among popular Rust computer vision libraries☆47Updated 7 months ago
- Rust matrix multiplication benchmarks☆19Updated 2 years ago