sidmanale643 / heliosView on GitHub
A small, readable PyTorch inference engine for Qwen3-4B with continuous batching, native paged attention, prefix caching, and an OpenAI-compatible chat completions API.
☆18Oct 20, 2026Updated this week

Alternatives and similar repositories for helios

Users that are interested in helios are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?