CLAIRE-Labo / StructuredFFN

The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"
14Updated 3 months ago

Related projects

Alternatives and complementary repositories for StructuredFFN