LlamaEdge / whisper-api-serverLinks
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
☆23Updated 7 months ago
Alternatives and similar repositories for whisper-api-server
Users that are interested in whisper-api-server are comparing it to the libraries listed below
Sorting:
- A RAG API server written in Rust following OpenAI specs☆57Updated 6 months ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆46Updated last year
- wasm-interface-types supplement & compiler of wasmedge☆16Updated 2 years ago
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆32Updated 2 months ago
- The MCP enterprise actors-based server or mcp-ectors for short☆31Updated 5 months ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆108Updated last month
- A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.☆171Updated last week
- AI Assistant☆20Updated 6 months ago
- A Fish Speech implementation in Rust, with Candle.rs☆98Updated 4 months ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- Embed WasmEdge functions in a Rust host app☆32Updated 10 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆64Updated last year
- bott: Your Terminal Copilot☆88Updated last year
- Enable AI agents to create and execute their own tools in Rust autonomously. Available as web API and MCP services☆53Updated 2 months ago
- A list of flow functions☆36Updated 2 years ago
- High-performance framework for building interactive multi-agent workflow systems in Rust☆175Updated last month
- OpenAI compatible API for serving LLAMA-2 model☆218Updated 2 years ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆76Updated last year
- Yet another `llama.cpp` Rust wrapper☆12Updated last year
- Implementing the BitNet model in Rust☆40Updated last year
- Minimalistic Rust Implementation Of Model Context Protocol from Anthropic☆59Updated 3 months ago
- An extensible CLI for integrating LLM models with a flexible scripting system☆22Updated last year
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆237Updated 3 weeks ago
- ☆255Updated last month
- Run LLaMA inference on CPU, with Rust 🦀🚀🦙☆30Updated 9 months ago
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆42Updated 11 months ago
- ChronoMind: Redefining Vector Intelligence Through Time.☆71Updated 6 months ago
- Rust implementation of Surya☆61Updated 8 months ago
- Rust bindings for OpenNMT/CTranslate2☆44Updated 2 weeks ago
- This application demonstrates how to launch high-performance "serverless" functions from the YoMo framework to process streaming data. Th…☆65Updated last year