YuchuanTian / DiJiang

[ICML'24 Oral] The official code of "DiJiang: Efficient Large Language Models through Compact Kernelization", a novel DCT-based linear attention mechanism.
98Updated 4 months ago

Related projects

Alternatives and complementary repositories for DiJiang