Alternatives and similar repositories for Fast-Weight-Memory-public

Users that are interested in Fast-Weight-Memory-public are comparing it to the libraries listed below

• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆33Updated 2 months ago
• yoonkim / neural-qcfg
  ☆45Updated 3 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• jason9693 / FROZEN
  ☆14Updated 3 years ago
• nng555 / ssmba
  ☆62Updated 3 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆12Updated 5 years ago
• lucidrains / memory-transformer-xl
  A variant of Transformer-XL where the memory is updated not with a queue, but with attention
  ☆49Updated 5 years ago
• lifu-tu / ENGINE
  ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation
  ☆25Updated 4 years ago
• sarthmit / Compositional-Attention
  Code to reproduce the results for Compositional Attention
  ☆60Updated 2 years ago
• thunlp / DPT
  ☆13Updated 3 years ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 3 years ago
• CAMTL / CA-MTL
  Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data
  ☆57Updated 4 years ago
• belindal / TaskBench500
  Suite of 500 procedurally-generated NLP tasks to study language model adaptability
  ☆21Updated 3 years ago
• JunShern / few-shot-adaptation
  Exploring Few-Shot Adaptation of Language Models with Tables
  ☆24Updated 3 years ago
• jenni-ai / T2FW
  Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
  ☆19Updated 2 years ago
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆46Updated 4 years ago
• jungokasai / twist_decoding
  ☆29Updated 3 years ago
• lucidrains / memformer
  Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
  ☆120Updated 4 years ago
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆114Updated last year
• microsoft / EfficientLongSequenceModeling
  ☆51Updated 2 years ago
• INK-USC / NExT
  Source Code for paper "Learning from Explanations with Neural Execution Tree", ICLR 2020
  ☆18Updated 4 years ago
• facebookresearch / Permutation-Equivariant-Seq2Seq
  Humans understand novel sentences by composing meanings and roles of core language components. In contrast, neural network models for nat…
  ☆27Updated 5 years ago
• bigscience-workshop / architecture-objective
  ☆97Updated 2 years ago
• frankaging / Reason-SCAN
  ReaSCAN is a synthetic navigation task that requires models to reason about surroundings over syntactically difficult languages. (NeurIPS…
  ☆20Updated 3 years ago
• MikeWangWZHL / Zemi
  Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings
  ☆16Updated 2 years ago
• lucidrains / learning-to-expire-pytorch
  An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
  ☆34Updated 4 years ago
• acmi-lab / pretraining-with-nonsense
  Pretraining summarization models using a corpus of nonsense
  ☆13Updated 3 years ago
• harvardnlp / hmm-lm
  ☆41Updated 4 years ago
• jungokasai / deep-shallow
  ☆44Updated 4 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 4 years ago