LlamaEdge / whisper-api-serverLinks
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
☆24Updated 9 months ago
Alternatives and similar repositories for whisper-api-server
Users that are interested in whisper-api-server are comparing it to the libraries listed below
Sorting:
- A RAG API server written in Rust following OpenAI specs☆58Updated 8 months ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆46Updated last year
- wasm-interface-types supplement & compiler of wasmedge☆17Updated 2 years ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆110Updated last month
- The MCP enterprise actors-based server or mcp-ectors for short☆32Updated 6 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆64Updated last year
- AI Assistant☆20Updated 8 months ago
- Use mcp to manage containerd(developing)☆50Updated 4 months ago
- Build tools for LLMs in Rust using Model Context Protocol☆38Updated 10 months ago
- Rust implementation of Surya☆63Updated 9 months ago
- Embed WasmEdge functions in a Rust host app☆33Updated last year
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆35Updated 4 months ago
- A crate for making MCP (Model Context Protocol) compatible programs with rust☆19Updated last year
- Light WebUI for lm.rs☆24Updated last year
- bott: Your Terminal Copilot☆87Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- ☆19Updated last year
- ChronoMind: Redefining Vector Intelligence Through Time.☆72Updated 7 months ago
- Rust port of llm.c by @karpathy☆44Updated last year
- A list of flow functions☆35Updated 2 years ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆77Updated last year
- This application demonstrates how to launch high-performance "serverless" functions from the YoMo framework to process streaming data. Th…☆65Updated last year
- A library-first, lightweight, high-performance, cloud-native supported API gateway🪐 by RUST☆28Updated last month
- Implementing the BitNet model in Rust☆42Updated last year
- This repository `II-Commons` contains tools for managing text and image datasets, including loading, fetching, and embedding large datase…☆33Updated 5 months ago
- A Fish Speech implementation in Rust, with Candle.rs☆106Updated 6 months ago
- ☆27Updated last year
- Portable LLM - A rust library for LLM inference☆10Updated last year
- High-performance framework for building interactive multi-agent workflow systems in Rust☆214Updated 3 weeks ago
- InfinyOn Labs projects☆14Updated last year