magnitudedev / magnitudeView on GitHub
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, or just a CPU.
☆6,726Oct 14, 2026Updated this week

Alternatives and similar repositories for magnitude

Users that are interested in magnitude are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?