LlamaEdge / whisper-api-server
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
☆13Updated last month
Alternatives and similar repositories for whisper-api-server:
Users that are interested in whisper-api-server are comparing it to the libraries listed below
- A RAG API server written in Rust following OpenAI specs☆49Updated last week
- AI Assistant☆20Updated last week
- Embed WasmEdge functions in a Rust host app☆32Updated 4 months ago
- ☆10Updated last week
- Build tools for LLMs in Rust using Model Context Protocol☆35Updated 2 months ago
- wasm-interface-types supplement & compiler of wasmedge☆15Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆59Updated 9 months ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆35Updated 11 months ago
- Lightweight web service clients in the WasmEdge Runtime using the Rust reqwest framework☆12Updated 9 months ago
- ChronoMind: Redefining Vector Intelligence Through Time.☆67Updated 3 months ago
- A Rust library for using stable diffusion functions when the Wasi is being executed on WasmEdge.☆11Updated 5 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆72Updated last year
- Implementing the BitNet model in Rust☆31Updated last year
- ☆24Updated 10 months ago
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆39Updated 5 months ago
- Flow function examples for flows.network☆25Updated last year
- A highly customable, adaptable, runtime agnostic and WASM/WASI friendly decentralized solution for service discovery and orchestration th…☆46Updated last month
- The MCP enterprise actors-based server or mcp-ectors for short☆28Updated 3 weeks ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.☆119Updated last month
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆58Updated last year
- Rust LLM Stream Analyzer and Content Generator☆21Updated 4 months ago
- ☆17Updated last year
- ☆13Updated 4 months ago
- TonboLite: Analysis-ready SQLite using Tonbo☆43Updated last month
- Run LLaMA inference on CPU, with Rust 🦀🚀🦙☆22Updated 3 months ago
- Library for doing RAG☆72Updated last month
- Light WebUI for lm.rs☆23Updated 6 months ago
- A collection of serverless apps that show how Fermyon's Serverless AI (currently in private beta) works. Reference: https://developer.fer…☆49Updated 4 months ago
- Use mcp to manage containerd(developing)☆16Updated last week