LlamaEdge / whisper-api-server
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
☆10Updated this week
Related projects ⓘ
Alternatives and complementary repositories for whisper-api-server
- A RAG API server written in Rust following OpenAI specs☆30Updated this week
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆13Updated this week
- ☆20Updated this week
- wasm-interface-types supplement & compiler of wasmedge☆14Updated last year
- Embed WasmEdge functions in a Rust host app☆30Updated last month
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated 9 months ago
- Implementing the BitNet model in Rust☆26Updated 6 months ago
- Rust implementation of Surya☆51Updated last month
- A Discord ChatGPT Bot☆10Updated last year
- The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…☆155Updated last month
- ☆46Updated 4 years ago
- Flow function examples for flows.network☆25Updated last year
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆38Updated 2 weeks ago
- Rust LLM Stream Analyzer and Content Generator☆16Updated 6 months ago
- Lightweight web service clients in the WasmEdge Runtime using the Rust reqwest framework☆12Updated 3 months ago
- Moly: an AI LLM GUI app in pure Rust☆153Updated this week
- Example of tch-rs on M1☆51Updated 7 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆59Updated 7 months ago
- A template project for building high-performance, portable, and safe serverless functions in Netlify.☆17Updated 3 years ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆26Updated 6 months ago
- Lightweight HTTP servers based on hyper / warp frameworks in the WasmEdge Runtime.☆83Updated 3 months ago
- An extensible CLI for integrating LLM models with a flexible scripting system☆22Updated 4 months ago
- Generative AI web UI and server☆21Updated last year
- ☆17Updated 4 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆46Updated 4 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆31Updated 4 months ago
- Ask shortgpt for instant and concise answers☆13Updated last year
- Run Generative AI models directly on your hardware☆22Updated 3 months ago
- OpenAI compatible API for serving LLAMA-2 model☆215Updated last year