robertknight / rten
ONNX neural network inference engine
☆181Updated this week
Alternatives and similar repositories for rten:
Users that are interested in rten are comparing it to the libraries listed below
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆181Updated this week
- Llama2 LLM ported to Rust burn☆277Updated 10 months ago
- Low rank adaptation (LoRA) for Candle.☆142Updated 6 months ago
- A Rust implementation of OpenAI's Whisper model using the burn framework☆290Updated 9 months ago
- Models and examples built with Burn☆213Updated 3 weeks ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆205Updated 8 months ago
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆121Updated 3 weeks ago
- A binary encoder/decoder for Rust☆416Updated this week
- Plotlars is a Rust library designed to facilitate the integration between the Polars data analysis library and Plotly library.☆393Updated last month
- Wrap a standalone FFmpeg binary in an intuitive Iterator interface. 🏍☆364Updated last month
- Run Generative AI models directly on your hardware☆29Updated 6 months ago
- Rust library for generating vector embeddings, reranking locally☆429Updated this week
- A Rust Websocket client that compiles to both native and web☆240Updated 3 months ago
- Atomically updatable variants of Arc and Weak for lock-free concurrency.☆180Updated 4 months ago
- ☆217Updated this week
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆69Updated 10 months ago
- An easy local data persistence layer for Rust, backed by SQLite.☆218Updated last week
- A template rendering engine based on Jinja, generating type-safe Rust code at compile time.☆302Updated this week
- A concurrent, append-only vector.☆149Updated this week
- A collection of different transport implementations and related tools focused primarily on web technologies.☆252Updated this week
- Stable Diffusion XL ported to Rust's burn framework☆258Updated 10 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆38Updated 11 months ago
- Tokio Rust Asynchronous Universal download MAnager☆141Updated this week
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆281Updated 6 months ago
- Faster implementations of standard library operations like find, filter, position etc.☆174Updated last week
- Nio is an experimental async runtime for Rust☆317Updated 2 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆376Updated this week
- Rust audio/video engine☆86Updated last year
- Safe wrapper around the Coqui STT C library☆111Updated last year
- Template to maintain a rust project running CI/CD with Github Workflows.☆116Updated 3 weeks ago