Skip to content
wici-ai / inferssdView on GitHub
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
☆1,224Nov 18, 2026Updated this week

Alternatives and similar repositories for inferssd

Users that are interested in inferssd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?