Alternatives and similar repositories for CATs

Users that are interested in CATs are comparing it to the libraries listed below

• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated 2 years ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• jenni-ai / T2FW
  Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
  ☆19Updated 2 years ago
• jungokasai / deep-shallow
  ☆44Updated 4 years ago
• jxhe / efficient-knnlm
  Pytorch implementation of paper "Efficient Nearest Neighbor Language Models" (EMNLP 2021)
  ☆72Updated 3 years ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆36Updated last year
• timvieira / vocrf
  Variable-order CRFs with structure learning
  ☆16Updated 9 months ago
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆24Updated last year
• yikangshen / megablocks
  ☆20Updated 11 months ago
• HazyResearch / anchor-stability
  A study of the downstream instability of word embeddings
  ☆12Updated 2 years ago
• acmi-lab / pretraining-with-nonsense
  Pretraining summarization models using a corpus of nonsense
  ☆13Updated 3 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 3 years ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆41Updated 2 years ago
• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆16Updated 3 years ago
• srush / transformers-bet
  ☆12Updated 3 years ago
• cliang1453 / CAMERO
  CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing (ACL 2022)
  ☆9Updated 3 years ago
• renll / SparseLT
  [EMNLP 2022] Language Model Pre-Training with Sparse Latent Typing
  ☆14Updated 2 years ago
• machelreid / editpro
  Learning to Model Editing Processes
  ☆26Updated 2 years ago
• xiamengzhou / training_trajectory_analysis
  [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf
  ☆24Updated last year
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆19Updated 9 months ago
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆33Updated 3 years ago
• princeton-nlp / align-mlm
  ☆13Updated 2 years ago
• GChrysostomou / ood_faith
  ☆13Updated last year
• zhangjiong724 / spectral-RNN
  STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION
  ☆16Updated 6 years ago
• lucy3 / whos_filtered
  ☆14Updated 7 months ago
• carolinlawrence / gradient-rollback
  Code for gradient rollback, which explains predictions of neural matrix factorization models, as for example used for knowledge base comp…
  ☆21Updated 4 years ago
• felixzli / synthetic_pretraining
  ☆39Updated 2 years ago
• adihaviv / nopos
  ☆22Updated last year
• cliang1453 / SAGE
  No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)
  ☆30Updated 3 years ago
• jungokasai / twist_decoding
  ☆29Updated 2 years ago