Doraemonzzz / Transformer-Evolution-PaperLinks
记录Transformer升级的论文笔记
☆19Updated 2 years ago
Alternatives and similar repositories for Transformer-Evolution-Paper
Users that are interested in Transformer-Evolution-Paper are comparing it to the libraries listed below
Sorting:
- Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》☆25Updated 3 years ago
- Crawl & visualize ICLR papers and reviews.☆18Updated 2 years ago
- [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling☆86Updated 2 years ago
- ☆11Updated last year
- Use the tokenizer in parallel to achieve superior acceleration☆18Updated last year
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Updated 2 years ago
- 服务器 GPU 监控程序,当 GPU 属性满足预设条件时通过微信发送提示消息☆32Updated 4 years ago
- Mixture of Attention Heads☆49Updated 3 years ago
- Methods and evaluation for aligning language models temporally☆30Updated last year
- [NeurIPS 2022] "A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models", Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li…☆21Updated last year
- ☆14Updated 2 years ago
- The official repo for the paper "Teacher Forcing Recovers Reward Functions for Text Generation"☆31Updated 2 years ago
- ☆14Updated last year
- [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)☆125Updated last year
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆38Updated last year
- A probabilitic model for contextual word representation. Accepted to ACL2023 Findings.☆25Updated last year
- [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning☆31Updated 2 years ago
- ☆18Updated last year
- ☆15Updated 2 years ago
- ☆18Updated 11 months ago
- Code for embedding and retrieval research.☆17Updated last year
- Implementation of QKVAE☆11Updated 2 years ago
- ☆21Updated 2 years ago
- Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …☆14Updated 2 years ago
- Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"☆41Updated 3 years ago
- self-adaptive in-context learning☆45Updated 2 years ago
- [NeurIPS 2024] Code and Data Repo for Paper "Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoning"☆27Updated last year
- Policies of scientific publisher and conferences towards large language model (LLM), such as ChatGPT☆75Updated 2 years ago
- This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…☆26Updated 2 years ago
- On the Effectiveness of Parameter-Efficient Fine-Tuning☆38Updated last year