THUDM / P-tuning
A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
☆928Updated 2 years ago
Alternatives and similar repositories for P-tuning:
Users that are interested in P-tuning are comparing it to the libraries listed below
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆917Updated 11 months ago
- An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks☆2,027Updated last year
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆1,021Updated 6 months ago
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆728Updated 2 years ago
- ☆345Updated 3 years ago
- CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation☆486Updated 2 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆471Updated last year
- PromptBERT: Improving BERT Sentence Embeddings with Prompts☆333Updated last year
- [NIPS2023] RRHF & Wombat☆806Updated last year
- AutoPrompt: Automatic Prompt Construction for Masked Language Models.☆616Updated 7 months ago
- Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer☆541Updated 3 years ago
- ☆397Updated 3 years ago
- A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.☆315Updated last year
- ☆459Updated 9 months ago
- 简单的向量白化改善句向量质量☆484Updated 3 years ago
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,618Updated last year
- Pytorch version of BERT-whitening☆308Updated 3 years ago
- FewCLUE 小样本学习测评基准,中文版☆506Updated 2 years ago
- RoFormer V1 & V2 pytorch☆491Updated 2 years ago
- Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo☆1,071Updated 8 months ago
- Original Implementation of Prompt Tuning from Lester, et al, 2021☆675Updated last month
- Unified Structure Generation for Universal Information Extraction☆924Updated 2 years ago
- Efficient Inference for Big Models☆580Updated 2 years ago
- A research project for natural language generation, containing the official implementations by MSRA NLC team.☆715Updated 8 months ago
- Efficient Training (including pre-training and fine-tuning) for Big Models☆579Updated 8 months ago
- Mengzi Pretrained Models☆534Updated 2 years ago
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,774Updated 2 years ago
- Fusion-in-Decoder☆565Updated last year
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,645Updated last year
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆282Updated last year