Alternatives and similar repositories for transformer-mgk

Users that are interested in transformer-mgk are comparing it to the libraries listed below

• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆61Updated 3 years ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 2 weeks ago
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated last month
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• archinetai / difformer-pytorch
  Diffusion based transformer, in PyTorch (Experimental).
  ☆24Updated 2 years ago
• serdarozsoy / corinfomax-ssl
  PyTorch implementation of CorInfoMax
  ☆21Updated 2 years ago
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated 2 years ago
• LukasHedegaard / continual-transformers
  Official Pytorch Implementation for "Continual Transformers: Redundancy-Free Attention for Online Inference" [ICLR 2023]
  ☆28Updated last year
• VITA-Group / layerGraftedPretraining_ICLR23
  [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…
  ☆24Updated 2 years ago
• nguyentthong / CrossSummOptimalTransport
  ☆23Updated 2 years ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆39Updated 3 years ago
• google-deepmind / ssl_hsic
  ☆37Updated 10 months ago
• fredzzhang / atlas
  [NeurIPS'24] Official PyTorch implementation for paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"
  ☆20Updated 4 months ago
• alexrame / diwa
  DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization
  ☆31Updated 2 years ago
• annosubmission / GRC-Cache
  ☆16Updated 2 years ago
• VinAIResearch / DSW
  Distributional Sliced-Wasserstein distance code
  ☆50Updated 11 months ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆60Updated last year
• lsj2408 / URPE
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆34Updated last year
• ChristophReich1996 / HyperMixer
  PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].
  ☆17Updated 3 years ago
• google-research / head2toe
  ☆81Updated 10 months ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆47Updated 2 years ago
• Optimization-AI / SogCLR
  Stochastic Optimization for Global Contrastive Learning without Large Mini-batches
  ☆20Updated 2 years ago
• astonzhang / Parameterization-of-Hypercomplex-Multiplications
  Implementation for the PHM paper at ICLR'21
  ☆12Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆124Updated last year
• GT-RIPL / Geometric-Sensitivity-Decomposition
  ☆18Updated 3 years ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆23Updated 2 years ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆73Updated last year
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆45Updated last year
• huaxiuyao / C-Mixup
  C-Mixup for NeurIPS 2022
  ☆70Updated last year
• yifanzhang-pro / Matrix-SSL
  Official implementation of ICML 2024 paper "Matrix Information Theory for Self-supervised Learning" (https://arxiv.org/abs/2305.17326)
  ☆28Updated 9 months ago