AIAnytime / LLM-Inference-API-in-Rust

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
β˜†19Updated last year

Alternatives and similar repositories for LLM-Inference-API-in-Rust:

Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below