hikarioyama / dsv4-flash-nvfp4-sm120View on GitHub
Serve DeepSeek-V4-Flash (NVFP4) on 2x RTX PRO 6000 (SM120) with working MTP speculative decoding (+38% single-stream). Root-cause fix: MTP draft experts are MXFP4, routed to Mxfp4MoEMethod.
☆18Jun 25, 2026Updated 3 months ago

Alternatives and similar repositories for dsv4-flash-nvfp4-sm120

Users that are interested in dsv4-flash-nvfp4-sm120 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?