toverainc / willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
401Updated 7 months ago

Alternatives and similar repositories for willow-inference-server:

Users that are interested in willow-inference-server are comparing it to the libraries listed below