A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..
โ517Oct 30, 2026Updated this week
Alternatives and similar repositories for Crane
Users that are interested in Crane are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ๐ฅ๐ฅ Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.โ834Oct 5, 2026Updated 3 weeks ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.โ739Oct 18, 2026Updated 2 weeks ago
- Fast, flexible LLM inferenceโ7,785Updated this week
- โ662Updated this week
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.โ345Updated this week
- Deploy on Railway without the complexity - Free Credits Offer โข AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Rust bindings for OpenNMT/CTranslate2โ63Updated this week
- Fast ML inference & training for ONNX models in Rustโ2,600Updated this week
- Llama got rusty and runs everywhere! ๐ฆโ53Updated this week
- Rust bindings to https://github.com/k2-fsa/sherpa-onnxโ313Mar 8, 2026Updated 7 months ago
- Minimalist ML framework for Rustโ21,257Updated this week
- Kokoro TTS็Rustๆจ็ๅฎ็ฐโ35Jun 1, 2026Updated 5 months ago
- Rust implementation of Qwen3-TTS speech synthesisโ150Feb 6, 2026Updated 8 months ago
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.โ24Mar 12, 2025Updated last year
- aha model inference library, now supports Qwen(2.5VL/3/3VL/3.5/ASR/3Embedding/3Reranker), MiniCPM(4/5), VoxCPM(0.5B/1.5/2), DeepSeek-OCR/โฆโ394Jun 7, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits โข AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Instant, controllable, local pre-trained AI models in Rustโ2,234Oct 24, 2026Updated last week
- zvec rust bindingโ30Oct 21, 2026Updated last week
- Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.โ16,207Updated this week
- โ๏ธ๐ฆ Build modular and scalable LLM Applications in Rustโ9,029Updated this week
- Rust library for generating vector embeddings and reranking locally!โ1,050Updated this week
- very fast speech-to-text, diarization, streaming (even in CPU) with NVIDIA Parakeet in Rustโ420Updated this week
- An educational Rust project for exporting and running inference on Qwen3 LLM familyโ43Aug 3, 2025Updated last year
- โ18Jul 1, 2025Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibesโ254Aug 6, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI โข AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Ultrafast PyTorch-like AI Framework Written from Ground-Up in Rustโ104Mar 18, 2026Updated 7 months ago
- Democratizing large model inference and training on any device.โ269Sep 4, 2026Updated last month
- fused MoE kernel in Candle backendโ14Feb 3, 2026Updated 8 months ago
- Fast serverless LLM inference, in Rust.โ136Sep 11, 2026Updated last month
- Candle Pipelines provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered โฆโ23Jan 5, 2026Updated 9 months ago
- Unofficial Rust bindings to Apple's mlx frameworkโ385Updated this week
- Implementation of Qwen3-ASR-0.6B in GGMLโ118Jul 28, 2026Updated 3 months ago
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, anโฆโ446Jul 30, 2026Updated 3 months ago
- High-performance Qwen3-TTS implementation | Instruction-driven ยท Zero-shot voice cloning ยท Streaming ยท RTF 0.55โ70Jun 26, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient โข AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A shadcn-ui for Dioxus Rust Web Frameworkโ11Jul 15, 2024Updated 2 years ago
- ๐ฆ A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AIโ602Mar 6, 2024Updated 2 years ago
- A native Rust toolkit for OCR, document layout analysis, and vision-language document understanding.โ196Updated this week
- โ27Jan 29, 2026Updated 9 months ago
- Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ๐๐ฆ Alternative to projects like llm-d,โฆโ1,685Updated this week
- A port of the RWKV v7 language model, implemented with the Burn deep learning frameworkโ14Jun 9, 2025Updated last year
- Tiny, no-nonsense, self-contained, Tensorflow and ONNX inferenceโ3,107Updated this week