onehr / llama-rsLinks
Run LLaMA inference on CPU, with Rust 🦀🚀🦙
☆33Updated last year
Alternatives and similar repositories for llama-rs
Users that are interested in llama-rs are comparing it to the libraries listed below
Sorting:
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆46Updated last year
- Library for doing RAG☆81Updated 3 weeks ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆240Updated last year
- Rust bindings to the Vosk API Speech Recognition library☆166Updated 5 months ago
- Low rank adaptation (LoRA) for Candle.☆169Updated 9 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- Models and examples built with Burn☆330Updated this week
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆253Updated last month
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆76Updated last year
- ONNX neural network inference engine☆280Updated last week
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆111Updated last month
- A high-level Rust implementation of the YOLO v11 object detection model.☆66Updated last week
- ☆62Updated last year
- High-performance framework for building interactive multi-agent workflow systems in Rust☆225Updated last month
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.☆139Updated 8 months ago
- Inference Llama 2 in one file of pure Rust 🦀☆235Updated 2 years ago
- ☆38Updated last year
- Friendly interface to chat with an Ollama instance.☆90Updated 4 months ago
- Highly optimized GUI automation rust library for controlling the mouse and keyboard, with template matching support.☆278Updated 2 months ago
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆40Updated 2 years ago
- Example of tch-rs on M1☆55Updated last year
- Rust implementation of VibeVoice text-to-speech with voice cloning and multi-speaker synthesis.☆52Updated 3 weeks ago
- Blazingly fast inference of diffusion models.☆118Updated 9 months ago
- pure rust implementaion for deep learning library like keras☆64Updated 3 years ago
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆139Updated last year
- LLama.cpp rust bindings☆411Updated last year
- Use piper TTS models in Rust☆46Updated last year
- A set of Rust macros for working with OpenAI function/tool calls.☆55Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated 2 years ago
- Run Generative AI models directly on your hardware☆41Updated last year