A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..
☆428Jul 21, 2026Updated this week
Alternatives and similar repositories for Crane
Users that are interested in Crane are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.☆799Jun 19, 2026Updated last month
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆700Jul 14, 2026Updated last week
- ☆615Updated this week
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆293Updated this week
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.☆24Mar 12, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast ML inference & training for ONNX models in Rust☆2,412Updated this week
- Rust implementation of Qwen3-TTS speech synthesis☆144Feb 6, 2026Updated 5 months ago
- Rust bindings for OpenNMT/CTranslate2☆58Updated this week
- Fast, flexible LLM inference☆7,508Updated this week
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆310Mar 8, 2026Updated 4 months ago
- A wrapper around the llama-cpp library for rust, including new Sampler API from llama-cpp.☆36Updated this week
- aha model inference library, now supports Qwen(2.5VL/3/3VL/3.5/ASR/3Embedding/3Reranker), MiniCPM(4/5), VoxCPM(0.5B/1.5/2), DeepSeek-OCR/…☆381Jun 7, 2026Updated last month
- A Rust 🦀 port of the Hugging Face smolagents library.☆43Mar 26, 2025Updated last year
- Rust library for generating vector embeddings, reranking locally!☆970Jul 15, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆44Aug 3, 2025Updated 11 months ago
- Instant, controllable, local pre-trained AI models in Rust☆2,212Jul 12, 2026Updated last week
- Ultrafast PyTorch-like AI Framework Written from Ground-Up in Rust☆102Mar 18, 2026Updated 4 months ago
- ☆18Jul 1, 2025Updated last year
- A native Rust toolkit for OCR, document layout analysis, and vision-language document understanding.☆132Updated this week
- very fast speech-to-text, diarization, streaming (even in CPU) with NVIDIA Parakeet in Rust☆373Jul 14, 2026Updated last week
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, an…☆431Jul 6, 2026Updated 2 weeks ago
- Democratizing large model inference and training on any device.☆263Jun 8, 2026Updated last month
- Minimalist ML framework for Rust☆20,696Jul 14, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Unofficial Rust bindings to Apple's mlx framework☆360Apr 18, 2026Updated 3 months ago
- ☆25Jan 29, 2026Updated 5 months ago
- ⚙️🦀 Build modular and scalable LLM Applications in Rust☆7,992Updated this week
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- ☆24Jan 22, 2025Updated last year
- Open-source options gamma exposure (GEX) & positioning dashboard — dealer GEX, max pain, open interest, IV surface. Self-hosted, Docker, …☆48Updated this week
- Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d,…☆1,643Updated this week
- Fast string seaching for node.js ( aho-corasick algorithm )☆13Jan 24, 2024Updated 2 years ago
- ☆17Aug 30, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Rust bindings for bitnet.cpp based on llama-cpp-4☆17Dec 28, 2025Updated 6 months ago
- Fast serverless LLM inference, in Rust.☆126Nov 5, 2025Updated 8 months ago
- High-performance Qwen3-TTS implementation | Instruction-driven · Zero-shot voice cloning · Streaming · RTF 0.55☆66Jun 26, 2026Updated 3 weeks ago
- RWKV-based Text-to-Speech implementation in Rust☆27Oct 14, 2025Updated 9 months ago
- Ridiculously fast & accurate streaming voice activity detection☆165Updated this week
- Models and examples built with Burn☆374Apr 28, 2026Updated 2 months ago
- A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.☆326Updated this week