Alternatives and similar repositories for param-share-transformer

Users that are interested in param-share-transformer are comparing it to the libraries listed below

• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆46Updated 4 years ago
• takase / share_layer_params
  ☆28Updated 4 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆118Updated 4 years ago
• lucidrains / n-grammer-pytorch
  Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
  ☆76Updated 3 years ago
• CAMTL / CA-MTL
  Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data
  ☆57Updated 4 years ago
• jungokasai / deep-shallow
  ☆44Updated 5 years ago
• lucidrains / memory-transformer-xl
  A variant of Transformer-XL where the memory is updated not with a queue, but with attention
  ☆49Updated 5 years ago
• haorannlp / mix
  Code for "Mixed Cross Entropy Loss for Neural Machine Translation"
  ☆20Updated 4 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 3 years ago
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆114Updated 2 years ago
• bigganbing / Fairseq_MorphTE
  [NeurIPS 2022]MorphTE: Injecting Morphology in Tensorized Embeddings
  ☆17Updated 3 years ago
• ictnlp / Seq-NAT
  Source code for <Sequence-Level Training for Non-Autoregressive Neural Machine Translation>.
  ☆24Updated 4 years ago
• facebookresearch / ELECTRA-Fewshot-Learning
  This repository contains the code for paper Prompting ELECTRA Few-Shot Learning with Discriminative Pre-Trained Models.
  ☆48Updated 3 years ago
• jojonki / BeamSearch
  Beam search decoding with Pytorch
  ☆54Updated last year
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆63Updated 3 years ago
• bojone / univae
  基于Transformer的单模型、多尺度的VAE模型
  ☆58Updated 4 years ago
• cambridgeltl / mirror-bert
  [EMNLP'21] Mirror-BERT: Converting Pretrained Language Models to universal text encoders without labels.
  ☆78Updated 3 years ago
• microsoft / COCO-LM
  [NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
  ☆118Updated 2 years ago
• bloodwass / mixout
  Implementation of Mixout with PyTorch
  ☆75Updated 3 years ago
• facebookresearch / DisCo
  DisCo Transformer for Non-autoregressive MT
  ☆77Updated 3 years ago
• jungokasai / beam_with_patience
  ☆46Updated 3 years ago
• mawentao277 / CharBERT
  CharBERT: Character-aware Pre-trained Language Model (COLING2020)
  ☆121Updated 5 years ago
• TianduoWang / DiffAug
  [EMNLP 2022] Differentiable Data Augmentation for Contrastive Sentence Representation Learning. https://arxiv.org/abs/2210.16536
  ☆40Updated 3 years ago
• Fraser-Greenlee / T5-VAE
  Checkout the new version at the link!
  ☆22Updated 5 years ago
• huiyegit / APLC_XLNet
  ☆19Updated 4 years ago
• cloneofsimo / realformer-pytorch
  Implementation of RealFormer using pytorch
  ☆101Updated 5 years ago
• RayeRen / multilingual-kd-pytorch
  ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation
  ☆70Updated 5 years ago
• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆76Updated 5 years ago
• ShannonAI / mrc-for-dependency-parsing
  ☆18Updated 4 years ago
• lucidrains / distilled-retriever-pytorch
  Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"
  ☆32Updated 5 years ago