Doraemonzzz / Transformer-Evolution-Paper

Related projects ⓘ

Alternatives and complementary repositories for Transformer-Evolution-Paper

• RunxinXu / ContrastivePruning
  Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》
  ☆23Updated 2 years ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• sanagno / adaptively_sparse_attention
  ☆17Updated last year
• llyx97 / sparse-and-robust-PLM
  [NeurIPS 2022] "A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models", Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li…
  ☆21Updated 10 months ago
• lancopku / DynamicKD
  Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"
  ☆40Updated 2 years ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated last year
• hyp1231 / ICLR2023-OpenReviewData
  Crawl & visualize ICLR papers and reviews.
  ☆18Updated 2 years ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆29Updated last year
• GeneZC / MiniMoE
  Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"
  ☆28Updated last year
• ghazi-f / QKVAE
  Implementation of QKVAE
  ☆11Updated last year
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• lancopku / well-classified-examples-are-underestimated
  Code for the AAAI 2022 publication "Well-classified Examples are Underestimated in Classification with Deep Neural Networks"
  ☆43Updated 2 years ago
• twinkle0331 / Xcompression
  [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)
  ☆19Updated last year
• jungokasai / T2R
  ☆13Updated 2 years ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆39Updated 2 years ago
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆42Updated 2 years ago
• lemon0830 / promptCSE
  code for promptCSE, emnlp 2022
  ☆11Updated last year
• RUCAIBox / QuantizedEmpirical
  ☆13Updated last year
• lipiji / uChecker
  Code of the COLING22 paper "uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers"
  ☆18Updated 2 years ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆28Updated last month
• LouChao98 / nner_as_parsing
  ☆15Updated last year
• chijames / KERPLE
  ☆17Updated 2 years ago
• yumeng5 / FewGen
  [ICML 2023] Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning
  ☆39Updated last year
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆37Updated last year
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆114Updated 8 months ago
• nuaa-nlp / paper-reading
  ☆44Updated last week
• sustcsonglin / disco-pointer
  Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …
  ☆14Updated last year
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆35Updated 7 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• thu-coai / TaiLr
  ICLR2023 - Tailoring Language Generation Models under Total Variation Distance
  ☆21Updated last year