LlamaEdge / sd-api-serverLinks
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
☆21Updated 3 months ago
Alternatives and similar repositories for sd-api-server
Users that are interested in sd-api-server are comparing it to the libraries listed below
Sorting:
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆15Updated 3 months ago
- A RAG API server written in Rust following OpenAI specs☆52Updated 2 months ago
- Embed WasmEdge functions in a Rust host app☆32Updated 6 months ago
- OpenAI compatible API for serving LLAMA-2 model☆218Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- Blazingly fast inference of diffusion models.☆108Updated 2 months ago
- Lightweight web service clients in the WasmEdge Runtime using the Rust reqwest framework☆11Updated 11 months ago
- A Rust library for using stable diffusion functions when the Wasi is being executed on WasmEdge.☆12Updated 7 months ago
- 🚀 Develop and run serverless applications on WebAssembly☆46Updated last year
- Fast serverless LLM inference, in Rust.☆77Updated 3 months ago
- AI Assistant☆20Updated 2 months ago
- ☆9Updated 5 years ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆222Updated last year
- The MCP enterprise actors-based server or mcp-ectors for short☆31Updated 3 weeks ago
- Simple Rust applications that run in WasmEdge☆32Updated last year
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆37Updated last year
- A Fish Speech implementation in Rust, with Candle.rs☆91Updated 3 weeks ago
- Rust bindings for OpenNMT/CTranslate2☆33Updated 2 months ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆82Updated this week
- A template project to run Rust functions in Deno through the Second State WebAssembly engine.☆53Updated 4 years ago
- ☆18Updated last year
- A collection of "agentic" MCP servers☆12Updated last month
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆61Updated 11 months ago
- ☆252Updated last week
- A simple wrapper for hiroi-sora/PaddleOCR-json.☆15Updated last year
- Lightweight database clients in the WasmEdge Runtime☆70Updated 10 months ago
- wasm-interface-types supplement & compiler of wasmedge☆16Updated last year
- Implementing the BitNet model in Rust☆37Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated last year
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆46Updated 4 months ago