kyegomez / SimplifiedTransformersView on GitHub
SimplifiedTransformer simplifies transformer block without affecting training. Skip connections, projection parameters, sequential sub-blocks, and normalization layers are removed. Experimental results confirm similar training speed and performance.
15May 11, 2026Updated last week

Alternatives and similar repositories for SimplifiedTransformers

Users that are interested in SimplifiedTransformers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?