LlamaEdge / sd-api-server
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
☆15Updated this week
Related projects ⓘ
Alternatives and complementary repositories for sd-api-server
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆10Updated this week
- Embed WasmEdge functions in a Rust host app☆30Updated 2 months ago
- A RAG API server written in Rust following OpenAI specs☆31Updated this week
- Rust functions for Tensorflow inference in Node.js. Rust's performance, WebAssembly's security and portability, and Javascript's ease-of-…☆56Updated 4 years ago
- Make ETLs Great Again!☆42Updated last year
- The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…☆158Updated last month
- ☆33Updated 4 months ago
- ☆21Updated 2 weeks ago
- Lightweight database clients in the WasmEdge Runtime☆66Updated 3 months ago
- wasm-interface-types supplement & compiler of wasmedge☆14Updated last year
- Asyncronous Rust Mysql driver based on Tokio for WASI.☆11Updated 11 months ago
- Lightweight web service clients in the WasmEdge Runtime using the Rust reqwest framework☆12Updated 4 months ago
- Lightweight HTTP servers based on hyper / warp frameworks in the WasmEdge Runtime.☆83Updated 4 months ago
- Let WebAssembly's exported function support more data types for its parameters and return values.☆30Updated last year
- ☆20Updated last year
- A template project to run Rust functions in Deno through the Second State WebAssembly engine.☆52Updated 4 years ago
- 🚀 Progressive microservices framework for Rust, based on and compatible with moleculerjs/moleculer☆21Updated last month
- ☆13Updated last year
- OpenAI compatible API for serving LLAMA-2 model☆215Updated last year
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆47Updated this week
- Rust application development framework for native and web applications☆52Updated 2 months ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆27Updated 6 months ago
- Library for doing RAG☆42Updated last week
- Turn your webcam into a face-detector with Rust, tract-onnx and axum!☆14Updated 2 months ago
- Rust Redis time series API☆22Updated 7 months ago
- Fast serverless LLM inference, in Rust.☆22Updated 2 weeks ago
- webtransport full stack dev kit for rustaceans☆28Updated 3 weeks ago
- Rust LLM Stream Analyzer and Content Generator☆16Updated 6 months ago
- `acts` is a fast, tiny, extensiable workflow engine☆33Updated this week
- InfinyOn Labs projects☆12Updated 6 months ago