THUDM / P-tuning
A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
☆923Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for P-tuning
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆896Updated 6 months ago
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆998Updated 2 months ago
- An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks☆1,985Updated last year
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆721Updated 2 years ago
- CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation☆481Updated last year
- PromptBERT: Improving BERT Sentence Embeddings with Prompts☆333Updated 11 months ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆466Updated 8 months ago
- [NIPS2023] RRHF & Wombat☆798Updated last year
- Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo☆1,031Updated 3 months ago
- ☆340Updated 3 years ago
- RoFormer V1 & V2 pytorch☆474Updated 2 years ago
- ☆394Updated 3 years ago
- A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.☆302Updated last year
- Paper List for In-context Learning 🌷☆818Updated last month
- AutoPrompt: Automatic Prompt Construction for Masked Language Models.☆595Updated 2 months ago
- Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer☆539Updated 2 years ago
- Fusion-in-Decoder☆549Updated last year
- Original Implementation of Prompt Tuning from Lester, et al, 2021☆657Updated 5 months ago
- ☆453Updated 5 months ago
- Efficient Inference for Big Models☆571Updated last year
- Unified Structure Generation for Universal Information Extraction☆899Updated 2 years ago
- Papers and Datasets on Instruction Tuning and Following. ✨✨✨☆459Updated 7 months ago
- Rotary Transformer☆822Updated 2 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,338Updated 8 months ago
- A research project for natural language generation, containing the official implementations by MSRA NLC team.☆692Updated 3 months ago
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆516Updated 2 years ago
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,607Updated last year
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,079Updated 8 months ago
- ☆273Updated 6 months ago
- Mengzi Pretrained Models☆534Updated last year