onehr / llama-rsLinks
Run LLaMA inference on CPU, with Rust π¦ππ¦
β29Updated 8 months ago
Alternatives and similar repositories for llama-rs
Users that are interested in llama-rs are comparing it to the libraries listed below
Sorting:
- High-level, optionally asynchronous Rust bindings to llama.cppβ229Updated last year
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candleβ75Updated last year
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Faceβ39Updated last year
- Low rank adaptation (LoRA) for Candle.β162Updated 5 months ago
- Rust bindings to the Vosk API Speech Recognition libraryβ149Updated 2 months ago
- Library for doing RAGβ77Updated 2 weeks ago
- LLama.cpp rust bindingsβ405Updated last year
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Eleβ¦β225Updated 3 weeks ago
- Unofficial Rust bindings to Apple's mlx frameworkβ192Updated this week
- β367Updated last week
- The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing andβ¦β205Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python packageβ226Updated 3 months ago
- π¦ A Pure Rust Framework For Building AGI (WIP).β103Updated last week
- Implementing the BitNet model in Rustβ39Updated last year
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.β137Updated 4 months ago
- An MCP server for rust crate docsβ53Updated last month
- Friendly interface to chat with an Ollama instance.β81Updated 3 weeks ago
- Rust bindings for OpenNMT/CTranslate2β42Updated 2 weeks ago
- Use piper TTS models in Rustβ35Updated 9 months ago
- Rust bindings to https://github.com/k2-fsa/sherpa-onnxβ222Updated 4 months ago
- Models and examples built with Burnβ286Updated 2 weeks ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.β75Updated last month
- ONNX neural network inference engineβ242Updated this week
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.β212Updated this week
- Democratizing large model inference and training on any device.β151Updated 3 weeks ago
- LLM training in simple, raw C/CUDA, migrated into Rustβ51Updated 6 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibesβ235Updated last month
- BEST Rust SDK for MCP (Model Context Protocol)β71Updated 6 months ago
- β60Updated 9 months ago
- A high-level Rust implementation of the YOLO v11 object detection model.β47Updated 2 months ago