Skip to content
xorbitsai / inferenceView on GitHub
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
☆9,663Nov 17, 2026Updated this week

Alternatives and similar repositories for inference

Users that are interested in inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?