KyanChen / MakeMultiHeadNaiveLinks
Use naive MultiheadAttention implement to replace nn.MultiheadAttention in pytorch
☆37Updated 7 months ago
Alternatives and similar repositories for MakeMultiHeadNaive
Users that are interested in MakeMultiHeadNaive are comparing it to the libraries listed below
Sorting:
- ☆172Updated last year
- [ICCV'23 Main Track, WECIA'23 Oral] Official repository of paper titled "Self-regulating Prompts: Foundational Model Adaptation without F…☆276Updated last year
- A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.☆406Updated last year
- ☆13Updated 2 years ago
- Collection of Composed Image Retrieval (CIR) papers.☆265Updated last month
- PyTorch Reimplementation of LoRA (featuring with supporting nn.MultiheadAttention in OpenCLIP)