CASE-Lab-UMD / LLM-Drop

The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
143Updated last week

Related projects

Alternatives and complementary repositories for LLM-Drop