re133 / sparse-memory-lmView on GitHub
A 21M-parameter LM with a 16.8M-row product-key memory: as good as a 114M dense model and runs with the table on an SSD. Triton kernels for ROCm and CUDA.
☆16Oct 23, 2026Updated this week

Alternatives and similar repositories for sparse-memory-lm

Users that are interested in sparse-memory-lm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?