pixelspark / poly

A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
79Updated last year

Alternatives and similar repositories for poly:

Users that are interested in poly are comparing it to the libraries listed below