A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
☆938Oct 6, 2022Updated 3 years ago
Alternatives and similar repositories for P-tuning
Users that are interested in P-tuning are comparing it to the libraries listed below
Sorting:
- An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks☆2,076Nov 16, 2023Updated 2 years ago
- P-tuning方法在中文上的简单实验☆140Apr 8, 2021Updated 4 years ago
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆958Apr 26, 2024Updated last year
- This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"☆1,628Jun 12, 2023Updated 2 years ago
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆730Aug 29, 2022Updated 3 years ago
- Must-read papers on prompt-based tuning for pre-trained language models.☆4,293Jul 17, 2023Updated 2 years ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,641Oct 16, 2024Updated last year
- AutoPrompt: Automatic Prompt Construction for Masked Language Models.☆641Aug 24, 2024Updated last year
- [NAACL 2021] Factual Probing Is [MASK]: Learning vs. Learning to Recall https://arxiv.org/abs/2104.05240☆168Oct 7, 2022Updated 3 years ago
- GLM (General Language Model)☆3,437Nov 3, 2023Updated 2 years ago
- An Open-Source Framework for Prompt-Learning.☆4,827Jul 16, 2024Updated last year
- ☆350Aug 8, 2021Updated 4 years ago
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆1,039Sep 19, 2024Updated last year
- Pattern-Exploiting Training在中文上的简单实验☆173Oct 10, 2020Updated 5 years ago
- Original Implementation of Prompt Tuning from Lester, et al, 2021☆697Mar 6, 2025Updated 11 months ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,580Mar 27, 2023Updated 2 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,156Jan 22, 2024Updated 2 years ago
- Language model Prompt And Query Archive☆160May 11, 2021Updated 4 years ago
- ☆89Sep 7, 2022Updated 3 years ago
- LAnguage Model Analysis☆1,390Jul 7, 2024Updated last year
- FewCLUE 小样本学习测评基准，中文版☆518Sep 21, 2022Updated 3 years ago
- ☆399Oct 12, 2021Updated 4 years ago
- Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer☆541Dec 10, 2021Updated 4 years ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,106May 9, 2024Updated last year
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,678Feb 24, 2026Updated last week
- Prompt Tuning with Rules☆163Sep 4, 2022Updated 3 years ago
- Code, Data and Demo for Paper: Controllable Generation from Pre-trained Language Models via Inverse Prompting☆124Dec 14, 2022Updated 3 years ago
- Toolkit for creating, sharing and using natural language prompts.☆2,996Oct 23, 2023Updated 2 years ago
- Instruction Tuning with GPT-4☆4,342Jun 11, 2023Updated 2 years ago
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,490Jan 14, 2026Updated last month
- [EMNLP 2022] Unifying and multi-tasking structured knowledge grounding with language models☆568Aug 22, 2023Updated 2 years ago
- Ongoing research training transformer models at scale☆15,461Updated this week
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,860Apr 6, 2023Updated 2 years ago
- 中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆4,230Feb 6, 2026Updated 3 weeks ago
- Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）☆10,175Jul 15, 2025Updated 7 months ago
- The code for our paper "NSP-BERT: A Prompt-based Zero-Shot Learner Through an Original Pre-training Task —— Next Sentence Prediction"☆230Oct 12, 2022Updated 3 years ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆22,033Jan 23, 2026Updated last month
- GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)☆7,669Jul 25, 2023Updated 2 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆475Mar 7, 2024Updated last year