Alternatives and similar repositories for sd-api-server

Users that are interested in sd-api-server are comparing it to the libraries listed below

• LlamaEdge / whisper-api-server
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆19Updated 5 months ago
• LlamaEdge / rag-api-server
  A RAG API server written in Rust following OpenAI specs
  ☆55Updated 4 months ago
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆218Updated last year
• lucasjinreal / Crane
  A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.
  ☆155Updated last month
• second-state / WasmEdge-WASINN-examples
  ☆254Updated last month
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆278Updated last year
• WasmEdge / mediapipe-rs
  The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…
  ☆203Updated 10 months ago
• EricLBuehler / diffusion-rs
  Blazingly fast inference of diffusion models.
  ☆113Updated 5 months ago
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆314Updated last week
• lucasjinreal / Kokoros
  🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.
  ☆587Updated last week
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆439Updated this week
• jkawamoto / ctranslate2-rs
  Rust bindings for OpenNMT/CTranslate2
  ☆40Updated 2 weeks ago
• mcp-ectors / mcp-ectors
  The MCP enterprise actors-based server or mcp-ectors for short
  ☆31Updated 3 months ago
• atoma-network / atoma-infer
  Fast serverless LLM inference, in Rust.
  ☆90Updated 5 months ago
• utilityai / llama-cpp-rs
  ☆348Updated this week
• thewh1teagle / sherpa-rs
  Rust bindings to https://github.com/k2-fsa/sherpa-onnx
  ☆207Updated 3 months ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆154Updated 4 months ago
• IncredibleDevHQ / agent-panel
  AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.
  ☆63Updated last year
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆228Updated last year
• mdrokz / rust-llama.cpp
  LLama.cpp rust bindings
  ☆398Updated last year
• reinterpretcat / qwen3-rs
  An educational Rust project for exporting and running inference on Qwen3 LLM family
  ☆27Updated 3 weeks ago
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆230Updated 3 weeks ago
• danielclough / fireside-chat
  An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…
  ☆136Updated 10 months ago
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆37Updated last year
• GaiaNet-AI / embedding-tools
  ☆12Updated 4 months ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆271Updated 2 weeks ago
• geminik23 / ai-agents
  a Rust library designed for building and managing generative AI agents, leveraging the capabilities of large language models (LLMs)
  ☆20Updated 4 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆259Updated 5 months ago
• dimfeld / chronicle
  LLM Proxy
  ☆12Updated last year