nogibjj / rust-candle-demosLinks
Demos using Rust Candle
☆80Updated 11 months ago
Alternatives and similar repositories for rust-candle-demos
Users that are interested in rust-candle-demos are comparing it to the libraries listed below
Sorting:
- Cookbook to build Rust Candle models☆82Updated 2 years ago
- A work in progress to build out solutions in Rust for MLOPs☆369Updated 11 months ago
- A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.☆275Updated this week
- LLM Orchestrator built in Rust☆284Updated last year
- MLOps Deploy Solutions with Rust☆37Updated 2 years ago
- Rust PyTorch GPU configuration☆49Updated 2 years ago
- A work in progress to build out solutions in Rust for MLOPs☆154Updated 11 months ago
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆138Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆249Updated 2 weeks ago
- Code for a Duke Coursera Rust-based data engineering course☆164Updated 11 months ago
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆17Updated 4 years ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆333Updated last year
- Rust client for Qdrant vector search engine☆364Updated last month
- Low rank adaptation (LoRA) for Candle.☆168Updated 8 months ago
- 🏆 A ranked list of awesome machine learning Rust libraries.☆458Updated 3 weeks ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆77Updated last year
- A good starting point for a new Rust project☆58Updated 11 months ago
- Inference Llama 2 in one file of pure Rust 🦀☆235Updated 2 years ago
- Models and examples built with Burn☆320Updated last month
- tutorial for Rust for Enterprise MLOps book by O'Reilly☆40Updated 2 years ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆46Updated last year
- High-performance framework for building interactive multi-agent workflow systems in Rust☆215Updated 3 weeks ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆240Updated 4 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆552Updated this week
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- Fast serverless LLM inference, in Rust.☆108Updated last month
- ☆140Updated last year
- 🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI☆510Updated last year
- Implementation of the Coursera ML course in Rust☆47Updated 10 months ago
- ☆135Updated last year