Alternatives and similar repositories for Pytorch-MiniLM:

Users that are interested in Pytorch-MiniLM are comparing it to the libraries listed below

• zhouj8553 / FlipDA
  ☆66Updated 10 months ago
• GeneZC / MiniMoE
  Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"
  ☆28Updated last year
• clovaai / ssmix
  Official PyTorch Implementation of SSMix (Findings of ACL 2021)
  ☆62Updated 3 years ago
• RunxinXu / ChildTuning
  Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
  ☆59Updated 3 years ago
• yeonsw / RankEncoder
  ☆35Updated last year
• dinghanshen / Cutoff
  The source code for the Cutoff data augmentation approach proposed in this paper: "A Simple but Tough-to-Beat Data Augmentation Approach …
  ☆63Updated 4 years ago
• JetRunner / MetaDistil
  Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".
  ☆85Updated 2 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆121Updated last year
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆196Updated last year
• XingLuxi / Cal-FLOPs-for-PLM
  Calculating FLOPs of Pre-trained Models in NLP
  ☆18Updated 4 years ago
• microsoft / SEED-Encoder
  ☆44Updated 3 years ago
• Lancelot39 / DCLR
  ☆24Updated 6 months ago
• amazon-science / sentence-representations
  ☆78Updated 2 years ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• zhaominyiz / EPiDA
  Official Code for 'EPiDA: An Easy Plug-in Data Augmentation Framework for High Performance Text Classification' - NAACL 2022
  ☆23Updated 2 years ago
• wangpf3 / consistent-CoT-distillation
  ☆39Updated last year
• YJiangcm / PromCSE
  [EMNLP 2022] Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning
  ☆134Updated last year
• microsoft / COCO-LM
  [NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
  ☆118Updated last year
• sh0416 / clrcmd
  Official Repository for CLRCMD (Appear in ACL2022)
  ☆40Updated 2 years ago
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆60Updated 3 years ago
• microsoft / REINA
  ☆116Updated 2 years ago
• thunlp / ELLE
  ☆32Updated 2 years ago
• LeeSureman / Sequence-Labeling-Early-Exit
  Code for ACL 2021 paper: Accelerating BERT Inference for Sequence Labeling via Early-Exit
  ☆28Updated 2 years ago
• xyltt / LPT
  This repo contains the code for Late Prompt Tuning.
  ☆11Updated last year
• Jxu-Thu / DITTO
  The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…
  ☆46Updated 2 years ago
• yxuansu / TaCL
  [NAACL'22] TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning
  ☆93Updated 2 years ago
• caskcsg / ir
  ConTextual Mask Auto-Encoder for Dense Passage Retrieval
  ☆35Updated 5 months ago
• bzantium / pytorch-PKD-for-BERT-compression
  ☆14Updated 5 years ago
• tencent-ailab / ICML21_OAXE
  ☆28Updated 3 years ago
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆103Updated 2 years ago