Alternatives and similar repositories for sd-api-server

Users that are interested in sd-api-server are comparing it to the libraries listed below

• LlamaEdge / rag-api-server
  A RAG API server written in Rust following OpenAI specs
  ☆60Updated 9 months ago
• LlamaEdge / whisper-api-server
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆26Updated 10 months ago
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆218Updated 2 years ago
• lucasjinreal / Crane
  A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.
  ☆229Updated 3 weeks ago
• mcp-ectors / mcp-ectors
  The MCP enterprise actors-based server or mcp-ectors for short
  ☆31Updated 7 months ago
• lucasjinreal / Kokoros
  🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.
  ☆685Updated last week
• second-state / WasmEdge-WASINN-examples
  ☆256Updated 3 months ago
• JackMatthewRimmer / rust-rag-toolchain
  Library for doing RAG
  ☆81Updated 3 weeks ago
• AtomaAI / atoma-infer
  Fast serverless LLM inference, in Rust.
  ☆108Updated 2 months ago
• EricLBuehler / diffusion-rs
  Blazingly fast inference of diffusion models.
  ☆118Updated 9 months ago
• WasmEdge / mediapipe-rs
  The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…
  ☆225Updated last week
• kevin-rs / autogpt
  🦀 A Pure Rust Framework For Building AGI (WIP).
  ☆111Updated last month
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated 2 years ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆285Updated last year
• jkawamoto / ctranslate2-rs
  Rust bindings for OpenNMT/CTranslate2
  ☆49Updated last week
• dimfeld / chronicle
  LLM Proxy
  ☆12Updated last year
• thewh1teagle / sherpa-rs
  Rust bindings to https://github.com/k2-fsa/sherpa-onnx
  ☆275Updated 2 months ago
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆240Updated last year
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆239Updated 5 months ago
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆46Updated last year
• pinokiocomputer / pinokiod
  Backend for https://github.com/pinokiocomputer/pinokio
  ☆60Updated last week
• utilityai / llama-cpp-rs
  ☆441Updated this week
• WasmEdge / wasmedge-rust-sdk
  Embed WasmEdge functions in a Rust host app
  ☆33Updated last year
• Ai00-X / ai00_server
  The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.
  ☆596Updated 3 months ago
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆106Updated 7 months ago
• PlugOvr-ai / PlugOvr
  AI Assistant
  ☆20Updated 9 months ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆169Updated 9 months ago
• IncredibleDevHQ / agent-panel
  AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.
  ☆65Updated last year
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆574Updated this week
• onehr / llama-rs
  Run LLaMA inference on CPU, with Rust 🦀🚀🦙
  ☆33Updated last year