Alternatives and similar repositories for MiniMoE

Users that are interested in MiniMoE are comparing it to the libraries listed below

• tongshoujie / MATCH-TUNING
  MATCH-TUNING
  ☆15Updated 3 years ago
• RunxinXu / ChildTuning
  Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
  ☆61Updated 3 years ago
• lipiji / uChecker
  Code of the COLING22 paper "uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers"
  ☆19Updated 2 years ago
• llyx97 / sparse-and-robust-PLM
  [NeurIPS 2022] "A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models", Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li…
  ☆21Updated last year
• RunxinXu / ContrastivePruning
  Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》
  ☆25Updated 3 years ago
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• pkunlp-icler / ChildTuning
  ☆32Updated 3 years ago
• pkunlp-icler / GroupMeeting
  Group Meeting Record for Baobao Chang Group in Peking University
  ☆26Updated 4 years ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago
• Yaoming95 / CIAT
  code repo for EMNLP'21 Finding Counter-Interference Adapter for Multilingual Machine Translation
  ☆18Updated 2 years ago
• ptlmasking / maskbert
  ☆20Updated 4 years ago
• yxuansu / TaCL
  [NAACL'22] TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning
  ☆93Updated 3 years ago
• dqxiu / CaliNet
  ☆33Updated 2 years ago
• Wangpeiyi9979 / ESD
  Code for NAACL2022 Long Paper "An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling"
  ☆28Updated 2 years ago
• txsun1997 / nlp-paradigm-shift
  Paradigm shift in natural language processing
  ☆42Updated 3 years ago
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆104Updated 2 years ago
• baoy-nlp / Latent-GLAT
  Implementation of latent-GLAT (ACL-2022)
  ☆33Updated 3 years ago
• FadedCosine / kNN-KD
  Code for paper "Nearest Neighbor Knowledge Distillation for Neural Machine Translation" by Zhixian Yang, Renliang Sun, and Xiaojun Wan. T…
  ☆31Updated 3 years ago
• Hi-ZenanXu / Syntax-Enhanced_Pre-trained_Model
  Source Data of ACL2021 paper "Syntax-Enhanced Pre-trained Model"
  ☆11Updated 4 years ago
• feyzaakyurek / dune
  Dataset for Unified Editing, EMNLP 2023. This is a model editing dataset where edits are natural language phrases.
  ☆23Updated 11 months ago
• dinghanshen / Cutoff
  The source code for the Cutoff data augmentation approach proposed in this paper: "A Simple but Tough-to-Beat Data Augmentation Approach …
  ☆63Updated 4 years ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆102Updated 2 years ago
• microsoft / REINA
  ☆117Updated 3 years ago
• MatthewCYM / SFLM
  ☆16Updated 3 years ago
• LooperXX / ProSLU
  Open source code and data for AAAI 2022 Oral Paper "Text is no more Enough! A Benchmark for Profile-based Spoken Language Understanding"
  ☆35Updated last year
• shizhediao / T-DNA
  Source code for the ACL-IJCNLP 2021 paper entitled "T-DNA: Taming Pre-trained Language Models with N-gram Representations for Low-Resourc…
  ☆19Updated 2 years ago
• princeton-nlp / EvalConvQA
  [ACL 2022] Ditch the Gold Standard: Re-evaluating Conversational Question Answering
  ☆45Updated 3 years ago
• Spico197 / awesome-lm-evaluation
  🩺 A collection of ChatGPT evaluation reports on various bechmarks.
  ☆49Updated 2 years ago
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• princeton-nlp / DinkyTrain
  Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration 🚃
  ☆114Updated 2 years ago