A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..
☆498Oct 10, 2026Updated this week
Alternatives and similar repositories for Crane
Users that are interested in Crane are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.☆827Updated this week
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆732Sep 17, 2026Updated 3 weeks ago
- ☆657Updated this week
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆334Sep 9, 2026Updated last month
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.☆24Mar 12, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Fast ML inference & training for ONNX models in Rust☆2,554Updated this week
- Rust implementation of Qwen3-TTS speech synthesis☆148Feb 6, 2026Updated 8 months ago
- Fast, flexible LLM inference☆7,736Oct 1, 2026Updated last week
- Rust bindings for OpenNMT/CTranslate2☆61Aug 31, 2026Updated last month
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆314Mar 8, 2026Updated 7 months ago
- A wrapper around the llama-cpp library for rust, including new Sampler API from llama-cpp.☆51Updated this week
- aha model inference library, now supports Qwen(2.5VL/3/3VL/3.5/ASR/3Embedding/3Reranker), MiniCPM(4/5), VoxCPM(0.5B/1.5/2), DeepSeek-OCR/…☆392Jun 7, 2026Updated 4 months ago
- A Rust 🦀 port of the Hugging Face smolagents library.☆43Mar 26, 2025Updated last year
- Rust library for generating vector embeddings and reranking locally!☆1,033Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆44Aug 3, 2025Updated last year
- Instant, controllable, local pre-trained AI models in Rust☆2,228Updated this week
- Ultrafast PyTorch-like AI Framework Written from Ground-Up in Rust☆104Mar 18, 2026Updated 6 months ago
- ☆18Jul 1, 2025Updated last year
- A native Rust toolkit for OCR, document layout analysis, and vision-language document understanding.☆179Updated this week
- very fast speech-to-text, diarization, streaming (even in CPU) with NVIDIA Parakeet in Rust☆408Updated this week
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, an…☆444Jul 30, 2026Updated 2 months ago
- Democratizing large model inference and training on any device.☆267Sep 4, 2026Updated last month
- Minimalist ML framework for Rust☆21,150Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Unofficial Rust bindings to Apple's mlx framework☆379Oct 3, 2026Updated last week
- ☆27Jan 29, 2026Updated 8 months ago
- ⚙️ 🦀 Build modular and scalable LLM Applications in Rust☆8,843Updated this week
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- ☆24Jan 22, 2025Updated last year
- Fast string seaching for node.js ( aho-corasick algorithm )☆12Jan 24, 2024Updated 2 years ago
- Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d,…☆1,675Updated this week
- Fast serverless LLM inference, in Rust.☆135Sep 11, 2026Updated last month
- Rust bindings for bitnet.cpp based on llama-cpp-4☆17Dec 28, 2025Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- High-performance Qwen3-TTS implementation | Instruction-driven · Zero-shot voice cloning · Streaming · RTF 0.55☆70Jun 26, 2026Updated 3 months ago
- RWKV-based Text-to-Speech implementation in Rust☆28Oct 14, 2025Updated 11 months ago
- Ridiculously fast & accurate streaming voice activity detection☆208Aug 30, 2026Updated last month
- Models and examples built with Burn☆384Oct 1, 2026Updated last week
- A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.☆337Updated this week
- A high-performance inference engine for AI models☆2,141Updated this week
- Utilities for encoding and decoding frames using `async/await`.☆34Jul 9, 2025Updated last year