thunlp / DeltaPapers
Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
☆272Updated last year
Related projects: ⓘ
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆510Updated 2 years ago
- Paper List for In-context Learning 🌷☆164Updated 6 months ago
- A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…☆274Updated last year
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆337Updated 2 months ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆253Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆190Updated 4 months ago
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆978Updated last year
- Paper collections of retrieval-based (augmented) language model.☆228Updated 3 months ago
- Papers and Datasets on Instruction Tuning and Following. ✨✨✨☆449Updated 5 months ago
- ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Model…☆258Updated last year
- Paper List for In-context Learning 🌷☆783Updated 2 months ago
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆144Updated 7 months ago
- The repository for the survey paper <<Survey on Large Language Models Factuality: Knowledge, Retrieval and Domain-Specificity>>☆323Updated 4 months ago
- ☆334Updated 3 years ago
- ☆310Updated 2 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆292Updated 8 months ago
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks☆239Updated last month
- An Awesome Collection for LLM Survey☆286Updated last week
- Collaborative Training of Large Language Models in an Efficient Way☆405Updated 3 weeks ago
- A curated reading list of research in Mixture-of-Experts(MoE).☆520Updated last year
- Collection of training data management explorations for large language models☆264Updated last month
- ☆139Updated 2 months ago
- awesome papers in LLM interpretability☆235Updated 3 weeks ago
- A paper & resource list of large language models, including course, paper, demo, figures☆184Updated last year
- A paper list about diffusion models for natural language processing.☆170Updated last year
- Code for "Lion: Adversarial Distillation of Proprietary Large Language Models (EMNLP 2023)"☆195Updated 7 months ago
- [ACL 2024] A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future☆275Updated 2 months ago
- LLM hallucination paper list☆268Updated 6 months ago
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆281Updated last week
- Must-read papers, related blogs and API tools on the pre-training and tuning methods for ChatGPT.☆315Updated last year