Alternatives and similar repositories for DataMUX:

Users that are interested in DataMUX are comparing it to the libraries listed below

• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆73Updated 4 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆58Updated 3 years ago
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆32Updated 3 years ago
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆101Updated 4 years ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆80Updated 3 years ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• frankaging / Reason-SCAN
  ReaSCAN is a synthetic navigation task that requires models to reason about surroundings over syntactically difficult languages. (NeurIPS…
  ☆20Updated 3 years ago
• castorini / transformers-arithmetic
  ☆38Updated 3 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 2 years ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆78Updated 4 years ago
• lucidrains / g-mlp-gpt
  GPT, but made only out of MLPs
  ☆88Updated 3 years ago
• rowanz / piglet
  PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World [ACL 2021]
  ☆54Updated 3 years ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 2 years ago
• MadryLab / EditingClassifiers
  ☆95Updated 2 years ago
• nng555 / ssmba
  ☆63Updated 2 years ago
• google-deepmind / emergent_in_context_learning
  ☆80Updated 6 months ago
• ischlag / Fast-Weight-Memory-public
  Official code repository of the paper Learning Associative Inference Using Fast Weight Memory by Schlag et al.
  ☆26Updated 3 years ago
• VITA-Group / BERT-Tickets
  [NeurIPS 2020] "The Lottery Ticket Hypothesis for Pre-trained BERT Networks", Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Ya…
  ☆139Updated 3 years ago
• naver / gdc
  Code accompanying our papers on the "Generative Distributional Control" framework
  ☆117Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• bigscience-workshop / architecture-objective
  ☆93Updated last year
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆44Updated last year
• yoonkim / neural-qcfg
  ☆45Updated 3 years ago
• lucidrains / memory-transformer-xl
  A variant of Transformer-XL where the memory is updated not with a queue, but with attention
  ☆47Updated 4 years ago
• jungokasai / deep-shallow
  ☆43Updated 4 years ago
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆109Updated last year
• Noahs-ARK / RFA
  ☆32Updated 3 years ago
• yikangshen / megablocks
  ☆18Updated 8 months ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆57Updated 3 years ago