Alternatives and similar repositories for Transformer-Evolution-Paper

Users that are interested in Transformer-Evolution-Paper are comparing it to the libraries listed below

• RunxinXu / ContrastivePruning
  Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》
  ☆25Updated 3 years ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆48Updated 2 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆123Updated last year
• hyp1231 / ICLR2023-OpenReviewData
  Crawl & visualize ICLR papers and reviews.
  ☆18Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆86Updated 2 years ago
• sanagno / adaptively_sparse_attention
  ☆21Updated 2 years ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago
• yafuly / SyntacticGen
  ☆15Updated 2 years ago
• MANGA-UOFA / LMReward
  The official repo for the paper "Teacher Forcing Recovers Reward Functions for Text Generation"
  ☆31Updated 2 years ago
• lemon0830 / promptCSE
  code for promptCSE, emnlp 2022
  ☆11Updated 2 years ago
• llyx97 / sparse-and-robust-PLM
  [NeurIPS 2022] "A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models", Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li…
  ☆21Updated last year
• IBM / selective-dense-state-space-model
  Open-sourcing code associated with the AAAI-25 paper "On the Expressiveness and Length Generalization of Selective State-Space Models on …
  ☆14Updated 3 months ago
• RenShuhuai-Andy / gpu_lurker
  服务器 GPU 监控程序，当 GPU 属性满足预设条件时通过微信发送提示消息
  ☆32Updated 4 years ago
• jungokasai / T2R
  ☆14Updated 2 years ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated 2 years ago
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆38Updated 2 years ago
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆48Updated 3 years ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year
• wutaiqiang / LLM_KD_AKL
  ☆16Updated 9 months ago
• JingfengYang / Multi-modal-Deep-Learning
  ☆73Updated 3 years ago
• Spico197 / watchmen
  😎 A simple and easy-to-use toolkit for GPU scheduling.
  ☆45Updated 3 months ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• tongshoujie / MATCH-TUNING
  MATCH-TUNING
  ☆15Updated 3 years ago
• JetRunner / MetaDistil
  Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".
  ☆86Updated 3 years ago
• MGheini / xattn-transfer-for-mt
  Code and data to accompany the camera-ready version of "Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Tra…
  ☆32Updated 3 years ago
• lancopku / well-classified-examples-are-underestimated
  Code for the AAAI 2022 publication "Well-classified Examples are Underestimated in Classification with Deep Neural Networks"
  ☆53Updated 2 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆54Updated 2 years ago
• TianduoWang / DiffAug
  [EMNLP 2022] Differentiable Data Augmentation for Contrastive Sentence Representation Learning. https://arxiv.org/abs/2210.16536
  ☆40Updated 2 years ago
• lancopku / DynamicKD
  Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"
  ☆41Updated 3 years ago
• Romainpkq / revisit_demon_selection_in_ICL
  ☆16Updated last year