nbigaouette / onnxruntime-rs
Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
☆283Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for onnxruntime-rs
- ☆115Updated 4 months ago
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆296Updated last year
- Example of tch-rs on M1☆51Updated 8 months ago
- Rust bindings for OpenVINO™☆85Updated last month
- Rust language bindings for Faiss☆199Updated 2 months ago
- Inference Llama 2 in one file of pure Rust 🦀☆229Updated last year
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆252Updated 3 months ago
- Fast ML inference & training for Rust with ONNX Runtime☆897Updated this week
- A machine learning library for Rust.☆314Updated 3 months ago
- Models and examples built with Burn☆185Updated this week
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆153Updated 2 months ago
- Low rank adaptation (LoRA) for Candle.☆127Updated 3 months ago
- Llama2 LLM ported to Rust burn☆274Updated 7 months ago
- Rust library for running TensorRT accelerated deep learning models☆51Updated 3 years ago
- Rust implementation of the HNSW algorithm (Malkov-Yashunin)☆158Updated 4 months ago
- 🏆 A ranked list of awesome machine learning Rust libraries.☆307Updated this week
- Statistical routines for ndarray☆201Updated 2 months ago
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)☆106Updated 2 months ago
- A Rust implementation of OpenAI's Whisper model using the burn framework☆270Updated 6 months ago
- Rust client for Qdrant vector search engine☆232Updated last month
- Tensors and differentiable operations (like TensorFlow) in Rust☆485Updated last year
- A comprehensive library for machine learning and numerical computing. The library provides a set of tools for linear algebra, numerical c…☆707Updated 3 months ago
- Stable Diffusion v1.4 ported to Rust's burn framework☆316Updated last month
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆265Updated last month
- Linear algebra package for rust-ndarray using LAPACK binding☆376Updated 3 months ago
- Simplistic API for deep learning tensor operations☆28Updated 3 weeks ago
- ONNX neural network inference engine☆124Updated this week
- A fun, hackable, GPU-accelerated, neural network library in Rust, written by an idiot☆122Updated 5 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆101Updated last year
- Computational graphs with reverse automatic differentation in the GPU☆387Updated 2 years ago