Alternatives and similar repositories for Fast-Weight-Memory-public

Users that are interested in Fast-Weight-Memory-public are comparing it to the libraries listed below

• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆33Updated 4 months ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• sarthmit / Compositional-Attention
  Code to reproduce the results for Compositional Attention
  ☆59Updated 2 years ago
• lucidrains / memory-transformer-xl
  A variant of Transformer-XL where the memory is updated not with a queue, but with attention
  ☆49Updated 5 years ago
• yoonkim / neural-qcfg
  ☆45Updated 4 years ago
• jason9693 / FROZEN
  ☆14Updated 3 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆12Updated 5 years ago
• nng555 / ssmba
  ☆62Updated 3 years ago
• CAMTL / CA-MTL
  Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data
  ☆57Updated 4 years ago
• INK-USC / NExT
  Source Code for paper "Learning from Explanations with Neural Execution Tree", ICLR 2020
  ☆18Updated 4 years ago
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆49Updated 4 years ago
• thunlp / DPT
  ☆13Updated 3 years ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 4 years ago
• lifu-tu / ENGINE
  ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation
  ☆25Updated 5 years ago
• jenni-ai / T2FW
  Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
  ☆19Updated 3 years ago
• belindal / TaskBench500
  Suite of 500 procedurally-generated NLP tasks to study language model adaptability
  ☆21Updated 3 years ago
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆114Updated last year
• deep-spin / mcan-vqa-continuous-attention
  ☆23Updated 5 years ago
• tatsu-lab / mlm_inductive_bias
  Code Release for "On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies"
  ☆16Updated 4 years ago
• facebookresearch / Permutation-Equivariant-Seq2Seq
  Humans understand novel sentences by composing meanings and roles of core language components. In contrast, neural network models for nat…
  ☆27Updated 5 years ago
• zhangjiong724 / spectral-RNN
  STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION
  ☆16Updated 7 years ago
• yaohungt / TransformerDissection
  [EMNLP'19] Summary for Transformer Understanding
  ☆53Updated 5 years ago
• jungokasai / deep-shallow
  ☆44Updated 5 years ago
• lucidrains / learning-to-expire-pytorch
  An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
  ☆34Updated 4 years ago
• lucidrains / memformer
  Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
  ☆123Updated 4 years ago
• frankaging / Reason-SCAN
  ReaSCAN is a synthetic navigation task that requires models to reason about surroundings over syntactically difficult languages. (NeurIPS…
  ☆19Updated 3 years ago
• bigscience-workshop / architecture-objective
  ☆98Updated 2 years ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆46Updated 4 years ago
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆25Updated 2 years ago
• jungokasai / twist_decoding
  ☆29Updated 3 years ago