robertknight / rten
ONNX neural network inference engine
☆187Updated this week
Alternatives and similar repositories for rten:
Users that are interested in rten are comparing it to the libraries listed below
- A Rust implementation of OpenAI's Whisper model using the burn framework☆294Updated 10 months ago
- Llama2 LLM ported to Rust burn☆277Updated 11 months ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆190Updated 3 weeks ago
- Low rank adaptation (LoRA) for Candle.☆144Updated 7 months ago
- Models and examples built with Burn☆223Updated 3 weeks ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆214Updated 9 months ago
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆137Updated this week
- A framework for declarative programming in Rust☆255Updated 3 months ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆285Updated 8 months ago
- Example of tch-rs on M1☆53Updated last year
- Wrap a standalone FFmpeg binary in an intuitive Iterator interface. 🏍☆375Updated last week
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆38Updated last year
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated last year
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆72Updated 11 months ago
- A Rust Websocket client that compiles to both native and web☆243Updated 4 months ago
- Unofficial Rust bindings to Apple's mlx framework☆139Updated this week
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆129Updated 5 months ago
- Plotlars is a Rust library designed to facilitate the integration between the Polars data analysis library and Plotly library.☆398Updated 2 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆329Updated this week
- A Rust crate for extracting readable content from web pages.☆131Updated this week
- Rust library for generating vector embeddings, reranking locally☆457Updated 2 weeks ago
- Rust executable packager, bundler and updater.☆283Updated last week
- A template rendering engine based on Jinja, generating type-safe Rust code at compile time.☆350Updated this week
- Rust client for Qdrant vector search engine☆269Updated this week
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆73Updated this week
- An easy local data persistence layer for Rust, backed by SQLite.☆221Updated 2 weeks ago
- Safe wrapper around the Coqui STT C library☆113Updated last year
- Implementation of the Coursera ML course in Rust☆37Updated last month
- Faster implementations of standard library operations like find, filter, position etc.☆174Updated last month
- A binary encoder/decoder for Rust☆433Updated last week