LlamaEdge / whisper-api-serverLinks
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
☆17Updated 4 months ago
Alternatives and similar repositories for whisper-api-server
Users that are interested in whisper-api-server are comparing it to the libraries listed below
Sorting:
- A RAG API server written in Rust following OpenAI specs☆53Updated 3 months ago
- ☆11Updated 2 months ago
- A Fish Speech implementation in Rust, with Candle.rs☆94Updated last month
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- The MCP enterprise actors-based server or mcp-ectors for short☆31Updated last month
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆63Updated last year
- Embed WasmEdge functions in a Rust host app☆32Updated 7 months ago
- Build tools for LLMs in Rust using Model Context Protocol☆38Updated 4 months ago
- AI Assistant☆20Updated 3 months ago
- OpenAI compatible API for serving LLAMA-2 model☆218Updated last year
- bott: Your Terminal Copilot☆87Updated last year
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆40Updated 8 months ago
- wasm-interface-types supplement & compiler of wasmedge☆16Updated last year
- ChronoMind: Redefining Vector Intelligence Through Time.☆72Updated 2 months ago
- A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.☆135Updated last month
- Implementing the BitNet model in Rust☆37Updated last year
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆46Updated 5 months ago
- Rust bindings for OpenNMT/CTranslate2☆33Updated 2 months ago
- The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…☆199Updated 9 months ago
- Rust implementation of Surya☆58Updated 4 months ago
- Flow function examples for flows.network☆25Updated 2 years ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆91Updated this week
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated last year
- ☆253Updated 3 weeks ago
- Mysql Change Data Capture Demo App for Fluvio Streaming Platform☆14Updated 2 years ago
- A secure and efficient gateway for interacting with OpenAI's API, featuring load balancing, user request handling without individual API …☆69Updated last year
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆37Updated last year
- A library-first, lightweight, high-performance, cloud-native supported API gateway🪐 by RUST☆27Updated 3 months ago
- Rust bindings to the https://github.com/coqui-ai TTS library☆19Updated 2 years ago
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆196Updated 2 months ago