Alternatives and similar repositories for transformer-mgk:

Users that are interested in transformer-mgk are comparing it to the libraries listed below

• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 2 years ago
• VITA-Group / layerGraftedPretraining_ICLR23
  [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…
  ☆23Updated 2 years ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• archinetai / difformer-pytorch
  Diffusion based transformer, in PyTorch (Experimental).
  ☆24Updated 2 years ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆37Updated 2 years ago
• nguyentthong / CrossSummOptimalTransport
  ☆21Updated last year
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated this week
• lucidrains / compositional-attention-pytorch
  Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…
  ☆50Updated 2 years ago
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated 2 years ago
• google-research / head2toe
  ☆81Updated 6 months ago
• Noahs-ARK / RFA
  ☆33Updated 3 years ago
• fredzzhang / atlas
  Official PyTorch implementation for NeurIPS'24 paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"
  ☆17Updated 2 months ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 2 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• annosubmission / GRC-Cache
  ☆16Updated last year
• lucidrains / multistream-transformers
  Implementation of Multistream Transformers in Pytorch
  ☆53Updated 3 years ago
• raymin0223 / self-contrastive-learning
  Self-Contrastive Learning: Single-viewed Supervised Contrastive Framework using Sub-network (AAAI 2023)
  ☆20Updated last year
• alexrame / diwa
  DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization
  ☆29Updated 2 years ago
• lucidrains / cross-transformers-pytorch
  Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch
  ☆51Updated 3 years ago
• 1202kbs / EBCLR
  Official PyTorch implementation of "Energy-Based Contrastive Learning of Visual Representations", NeurIPS 2022 Oral Paper
  ☆9Updated 2 years ago
• lsj2408 / URPE
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆34Updated last year
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆15Updated 3 years ago
• LooperXX / ManagerTower
  Code for ACL 2023 Oral Paper: ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning
  ☆11Updated last month
• sjoshi804 / sas-data-efficient-contrastive-learning
  Official Code for ICML 2023 Data-Efficient Contrastive Self-supervised Learning
  ☆32Updated 10 months ago
• VinAIResearch / DSW
  Distributional Sliced-Wasserstein distance code
  ☆49Updated 6 months ago
• alinlab / temporal-selfsupervision
  ☆33Updated 2 years ago
• changdaeoh / multimodal-mixup
  Official implementation for NeurIPS'23 paper "Geodesic Multi-Modal Mixup for Robust Fine-Tuning"
  ☆32Updated 4 months ago
• rehg-lab / CLRec
  Pytorch implementation for "The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction"
  ☆33Updated 2 years ago
• davidsvy / cosformer-pytorch
  Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".
  ☆44Updated 3 years ago