A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..
☆298Feb 24, 2026Updated 2 weeks ago
Alternatives and similar repositories for Crane
Users that are interested in Crane are comparing it to the libraries listed below
Sorting:
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.☆24Mar 12, 2025Updated 11 months ago
- 🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.☆722Jan 20, 2026Updated last month
- ☆24Jan 22, 2025Updated last year
- Cleanai (https://github.com/willmil11/cleanai) except I'm making it in c now. Fast and clean from the start this time :)☆17Updated this week
- the rent a hal project for AI☆22Aug 12, 2025Updated 6 months ago
- A Rust 🦀 port of the Hugging Face smolagents library.☆42Mar 26, 2025Updated 11 months ago
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆299Nov 1, 2025Updated 4 months ago
- ☆15Apr 9, 2025Updated 11 months ago
- Run Orpheus 3B Locally with Gradio UI, Standalone App☆23Apr 1, 2025Updated 11 months ago
- Graph model execution API for Candle☆17Jul 27, 2025Updated 7 months ago
- ☆64Jun 24, 2025Updated 8 months ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆47May 3, 2024Updated last year
- ☆18Aug 19, 2025Updated 6 months ago
- A pure and fast NumPy implementation of Mamba with cache support.☆18Jun 16, 2024Updated last year
- ☆49Mar 17, 2025Updated 11 months ago
- Fast, flexible LLM inference☆6,653Feb 27, 2026Updated last week
- ☆51Feb 19, 2025Updated last year
- A simple, "Ollama-like" tool for managing and running GGUF language models from your terminal.☆23Jan 2, 2026Updated 2 months ago
- ☆19Jul 4, 2025Updated 8 months ago
- ☆478Updated this week
- Service for testing out the new Qwen2.5 omni model☆63Apr 30, 2025Updated 10 months ago
- A forward proxy to turn network traffic into personal memory for AI agents☆36Feb 23, 2026Updated 2 weeks ago
- ☆177Aug 10, 2025Updated 6 months ago
- LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…☆48Feb 27, 2025Updated last year
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆59Dec 1, 2024Updated last year
- Fast ML inference & training for ONNX models in Rust☆2,042Updated this week
- An OpenVoice-based voice cloning tool, single executable file (~14M), supporting multiple formats without dependencies on ffmpeg, Python,…☆44Jan 18, 2026Updated last month
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆40Aug 3, 2025Updated 7 months ago
- Kotlin library for Cortex.cpp a Local AI API Platform that is used to run and customize LLMs.☆10Apr 2, 2025Updated 11 months ago
- A free and open-source GUI tool that simplifies combining multiple code files into one, with automatic labeling and support for various p…☆14Jan 3, 2025Updated last year
- Fast serverless LLM inference, in Rust.☆110Nov 5, 2025Updated 4 months ago
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated 11 months ago
- LLM inference in C/C++☆23Oct 4, 2024Updated last year
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆78Dec 17, 2024Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆244Aug 6, 2025Updated 7 months ago
- Rust library for vector embeddings and reranking.☆787Updated this week
- A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp☆16Feb 10, 2026Updated 3 weeks ago
- Get aid from local LLMs right in your PowerShell☆15May 2, 2025Updated 10 months ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Sep 14, 2025Updated 5 months ago