AIAnytime / LLM-Inference-API-in-Rust

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
17Updated last year

Related projects

Alternatives and complementary repositories for LLM-Inference-API-in-Rust