Skip to content
xl03-bit / sm120-nvfp4-trainingView on GitHub
Full NVFP4 training for GeForce RTX 50-series and RTX PRO 6000 Blackwell GPUs (SM120). Built on Infatoshi/nvfp4-sm120, with software stochastic rounding, random Hadamard transforms and six profiles for speed and memory. On one RTX 5060 Ti 16GB, validation loss fell over 2,048 full-parameter FineWeb updates of a 4.06B model.
☆88Nov 9, 2026Updated this week

Alternatives and similar repositories for sm120-nvfp4-training

Users that are interested in sm120-nvfp4-training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?