benjaminegger / rust-inference-serviceLinks

Inference service built in Rust for deploying Large Language Models
82Updated 4 months ago

Alternatives and similar repositories for rust-inference-service

Users that are interested in rust-inference-service are comparing it to the libraries listed below

Sorting: