lucasjinreal / CraneLinks
A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.
☆126Updated last week
Alternatives and similar repositories for Crane
Users that are interested in Crane are comparing it to the libraries listed below
Sorting:
- A Fish Speech implementation in Rust, with Candle.rs☆91Updated 2 weeks ago
- Blazingly fast inference of diffusion models.☆108Updated 2 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆203Updated 4 months ago
- Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.☆244Updated 2 weeks ago
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆188Updated last month
- git-like rag pipeline☆230Updated last week
- ☆129Updated last month
- Library for doing RAG☆74Updated last month
- 🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.☆539Updated 3 weeks ago
- ☆299Updated this week
- A real-time speech-to-speech chatbot powered by Whisper Small, Llama 3.2, and Kokoro-82M.☆229Updated 5 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆85Updated last week
- Kyutai with an "eye"☆200Updated 2 months ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆221Updated last year
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆95Updated 3 months ago
- ☆145Updated last month
- automatically quant GGUF models☆184Updated last week
- InferX is a Inference Function as a Service Platform☆111Updated this week
- TTS support with GGML☆117Updated this week
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆380Updated this week
- fast state-of-the-art speech models and a runtime that runs anywhere 💥☆55Updated last week
- Speech-to-speech AI assistant with natural conversation flow, mid-speech interruption, vision capabilities and AI-initiated follow-ups. F…☆170Updated 2 months ago
- Testing LLM reasoning abilities with family relationship quizzes.☆62Updated 4 months ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more seamlessly leveraging RAG and extensible modules.☆140Updated 5 months ago
- Orpheus Chat WebUI☆65Updated 2 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆56Updated 6 months ago
- Distributed Inference for mlx LLm☆93Updated 10 months ago
- Low rank adaptation (LoRA) for Candle.☆150Updated 2 months ago
- A random walk voice style cloning application for Kokoro text to speech☆98Updated last week