haixuanTao / onnxruntime-rsLinks
Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)
โ23Updated 3 years ago
Alternatives and similar repositories for onnxruntime-rs
Users that are interested in onnxruntime-rs are comparing it to the libraries listed below
Sorting:
- A Demo server serving Bert through ONNX with GPU written in Rust with <3โ40Updated 3 years ago
- ๐ฆ Example of serving deep learning models in Rust with batched predictionโ34Updated 2 years ago
- Your one stop CLI for ONNX model analysis.โ47Updated 2 years ago
- โ23Updated 2 months ago
- โ27Updated last year
- An extension library to Candle that provides PyTorch functions not currently available in Candleโ40Updated last year
- A Rust Library for High-Performance Tensor Exchange with Pythonโ47Updated last week
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)โ301Updated last year
- โ89Updated 6 months ago
- โ47Updated last year
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.โ74Updated this week
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.โ78Updated last year
- This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.โ16Updated 3 years ago
- 8-bit floating point types for Rustโ47Updated 4 months ago
- A neural network inference library, written in Rust.โ63Updated last year
- Sample Python extension using Rust/PyO3/tch to interact with PyTorchโ37Updated last year
- ๐งฎ alphatensor matrix breakthrough algorithms + simd + rust.โ61Updated 2 years ago
- GPU based FFT written in Rust and CubeCLโ23Updated last month
- Fast English word segmentation in Rustโ99Updated 2 weeks ago
- Dataflow is a data processing library, primarily for machine learning.โ23Updated 2 years ago
- โ30Updated 7 months ago
- Einstein summation for Rustโ40Updated 4 years ago
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)โ117Updated 9 months ago
- Locality Sensitive Hashing in Rust with Python bindingsโ116Updated 2 years ago
- Rust library for running TensorRT accelerated deep learning modelsโ56Updated 3 years ago
- Experimental ONNX implementation for WASI NN.โ48Updated 3 years ago
- A Rust Vector which swaps to disk based on given parametersโ44Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rustโ80Updated last year
- Rust port of annoy (https://github.com/spotify/annoy)โ44Updated last month
- A neural network library written from scratch in Rust along with a web-based application for building + training neural networks + visualโฆโ133Updated 9 months ago