thunlp / DeltaPapers
Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
β281Updated last year
Alternatives and similar repositories for DeltaPapers:
Users that are interested in DeltaPapers are comparing it to the libraries listed below
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)β522Updated 2 years ago
- Paper List for In-context Learning π·β176Updated last year
- A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or lβ¦β277Updated last year
- Papers and Datasets on Instruction Tuning and Following. β¨β¨β¨β481Updated 10 months ago
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)β1,013Updated 5 months ago
- ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Modelβ¦β265Updated 2 years ago
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learningβ161Updated last year
- Paper List for In-context Learning π·β836Updated 4 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuningβ412Updated 4 months ago
- Paper collections of retrieval-based (augmented) language model.β231Updated 8 months ago
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarksβ255Updated 6 months ago
- β163Updated 7 months ago
- Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`β160Updated 2 months ago
- The repository for the survey paper <<Survey on Large Language Models Factuality: Knowledge, Retrieval and Domain-Specificity>>β332Updated 9 months ago
- Collaborative Training of Large Language Models in an Efficient Wayβ411Updated 5 months ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).β291Updated last year
- Awesome papers on Language-Model-as-a-Service (LMaaS)β556Updated 9 months ago
- Must-read papers, related blogs and API tools on the pre-training and tuning methods for ChatGPT.β318Updated last year
- β318Updated 7 months ago
- [EMNLP 2023] Lion: Adversarial Distillation of Proprietary Large Language Modelsβ203Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignmentβ284Updated 9 months ago
- A paper list about diffusion models for natural language processing.β181Updated last year
- A paper & resource list of large language models, including course, paper, demo, figuresβ197Updated last year
- Collection of training data management explorations for large language modelsβ310Updated 6 months ago
- All available datasets for Instruction Tuning of Large Language Modelsβ242Updated last year
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).β760Updated last year
- [SIGIR'24] The official implementation code of MOELoRA.β145Updated 6 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasetsβ312Updated last year
- β346Updated 3 years ago
- The related works and background techniques about Openai o1β210Updated last month