Alternatives and similar repositories for Transformer-Evolution-Paper

Users that are interested in Transformer-Evolution-Paper are comparing it to the libraries listed below

• RunxinXu / ContrastivePruning
  Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》
  ☆25Updated 4 years ago
• hyp1231 / ICLR2023-OpenReviewData
  Crawl & visualize ICLR papers and reviews.
  ☆18Updated 3 years ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago
• llyx97 / sparse-and-robust-PLM
  [NeurIPS 2022] "A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models", Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li…
  ☆21Updated 2 years ago
• sanagno / adaptively_sparse_attention
  ☆22Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆87Updated 2 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆128Updated last year
• JungHoyoun / PromptCompressor
  ☆12Updated last year
• nuaa-nlp / paper-reading
  ☆45Updated 2 months ago
• whyNLP / Probabilistic-Transformer
  A probabilitic model for contextual word representation. Accepted to ACL2023 Findings.
  ☆25Updated 2 years ago
• OpenLMLab / ParallelTokenizer
  Use the tokenizer in parallel to achieve superior acceleration
  ☆20Updated last year
• JetRunner / MetaDistil
  Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".
  ☆87Updated 3 years ago
• yafuly / SyntacticGen
  ☆16Updated 2 years ago
• ghazi-f / QKVAE
  Implementation of QKVAE
  ☆11Updated 2 years ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆51Updated 3 years ago
• RenShuhuai-Andy / gpu_lurker
  服务器 GPU 监控程序，当 GPU 属性满足预设条件时通过微信发送提示消息
  ☆32Updated 4 years ago
• VITA-Group / Data-Efficient-Scaling
  [ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang
  ☆14Updated 2 years ago
• Spico197 / watchmen
  😎 A simple and easy-to-use toolkit for GPU scheduling.
  ☆45Updated 8 months ago
• MANGA-UOFA / LMReward
  The official repo for the paper "Teacher Forcing Recovers Reward Functions for Text Generation"
  ☆31Updated 2 years ago
• ptlmasking / maskbert
  ☆20Updated 5 years ago
• jungokasai / T2R
  ☆14Updated 3 years ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆44Updated last year
• TianduoWang / DiffAug
  [EMNLP 2022] Differentiable Data Augmentation for Contrastive Sentence Representation Learning. https://arxiv.org/abs/2210.16536
  ☆40Updated 3 years ago
• sustcsonglin / disco-pointer
  Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …
  ☆14Updated 2 years ago
• Shark-NLP / self-adaptive-ICL
  self-adaptive in-context learning
  ☆45Updated 2 years ago
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆51Updated 3 years ago
• lancopku / well-classified-examples-are-underestimated
  Code for the AAAI 2022 publication "Well-classified Examples are Underestimated in Classification with Deep Neural Networks"
  ☆54Updated 3 years ago
• RUCAIBox / ELMER
  This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…
  ☆26Updated 3 years ago
• tongshoujie / MATCH-TUNING
  MATCH-TUNING
  ☆15Updated 3 years ago
• wutaiqiang / LLM_KD_AKL
  ☆22Updated last year