yalun753 / moe-l2View on GitHub
MoE expert offload for low-VRAM GPUs — run 100B+ MoE models (DeepSeek, Qwen, Mixtral) on 8 GB cards. Expert cache with LRU hot experts, OpenAI-compatible proxy, GGUF multi-shard.
☆151Oct 1, 2026Updated 2 weeks ago

Alternatives and similar repositories for moe-l2

Users that are interested in moe-l2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?