nektarlabs / infernoView on GitHub
Inferno aims to be a super lightweight, highly efficient Rust inference engine for running open weights models on Apple Silicon with Metal, targeting machines such as a MacBook Pro with 64 GB of unified memory.
44Jul 31, 2026Updated this week

Alternatives and similar repositories for inferno

Users that are interested in inferno are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?