affifuddin-hazam / ghost-inferView on GitHub
Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
☆44Nov 5, 2026Updated this week

Alternatives and similar repositories for ghost-infer

Users that are interested in ghost-infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?