THUDM / P-tuning
A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
☆923Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for P-tuning
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆893Updated 6 months ago
- An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks☆1,981Updated 11 months ago
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆996Updated last month
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆720Updated 2 years ago
- CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation☆481Updated last year
- PromptBERT: Improving BERT Sentence Embeddings with Prompts☆332Updated 11 months ago
- A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.☆301Updated last year
- ☆339Updated 3 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆466Updated 8 months ago
- [NIPS2023] RRHF & Wombat☆797Updated last year
- Original Implementation of Prompt Tuning from Lester, et al, 2021☆652Updated 5 months ago
- ☆392Updated 3 years ago
- Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer☆539Updated 2 years ago
- AutoPrompt: Automatic Prompt Construction for Masked Language Models.☆594Updated 2 months ago
- ☆451Updated 5 months ago
- RoFormer V1 & V2 pytorch☆473Updated 2 years ago
- Paper List for In-context Learning 🌷☆815Updated last month
- Unified Structure Generation for Universal Information Extraction☆889Updated 2 years ago
- Rotary Transformer☆811Updated 2 years ago
- 简单的向量白化改善句向量质量☆481Updated 3 years ago
- Resource, Evaluation and Detection Papers for ChatGPT☆452Updated 7 months ago
- ☆887Updated 5 months ago
- A PyTorch-based model pruning toolkit for pre-trained language models☆369Updated last year
- Papers and Datasets on Instruction Tuning and Following. ✨✨✨☆457Updated 7 months ago
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,607Updated last year
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆274Updated last year
- Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo☆1,027Updated 3 months ago
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,073Updated 7 months ago
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆517Updated 2 years ago
- ACL 2022: BRIO: Bringing Order to Abstractive Summarization☆330Updated 3 weeks ago