A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
☆1,041Sep 19, 2024Updated last year
Alternatives and similar repositories for OpenDelta
Users that are interested in OpenDelta are comparing it to the libraries listed below
Sorting:
- An Open-Source Framework for Prompt-Learning.☆4,838Jul 16, 2024Updated last year
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆284Jun 27, 2023Updated 2 years ago
- Must-read papers on prompt-based tuning for pre-trained language models.☆4,297Jul 17, 2023Updated 2 years ago
- Efficient Training (including pre-training and fine-tuning) for Big Models☆624Oct 27, 2025Updated 4 months ago
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆543Mar 24, 2022Updated 3 years ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learning☆2,804Mar 1, 2026Updated 2 weeks ago
- ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Model…☆271Nov 8, 2022Updated 3 years ago
- Live Training for Open-source Big Models☆505May 30, 2023Updated 2 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆475Mar 7, 2024Updated 2 years ago
- Awesome papers on Language-Model-as-a-Service (LMaaS)☆546May 14, 2024Updated last year
- Efficient Inference for Big Models☆587Jan 24, 2023Updated 3 years ago
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆961Apr 26, 2024Updated last year
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,643Oct 16, 2024Updated last year
- Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)☆2,805Mar 13, 2024Updated 2 years ago
- A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.☆938Oct 6, 2022Updated 3 years ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,809Updated this week
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,769Aug 4, 2024Updated last year
- PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"☆241Jan 20, 2023Updated 3 years ago
- A modular RL library to fine-tune language models to human preferences☆2,382Mar 1, 2024Updated 2 years ago
- An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks☆2,077Nov 16, 2023Updated 2 years ago
- ☆399Oct 12, 2021Updated 4 years ago
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆730Aug 29, 2022Updated 3 years ago
- Model Compression for Big Models☆168Jun 30, 2023Updated 2 years ago
- Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins☆2,785Dec 5, 2023Updated 2 years ago
- Efficient, Low-Resource, Distributed transformer implementation based on BMTrain☆268Nov 27, 2023Updated 2 years ago
- Toolkit for creating, sharing and using natural language prompts.☆3,006Oct 23, 2023Updated 2 years ago
- ☆131Aug 18, 2022Updated 3 years ago
- Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration 🚃☆116Oct 27, 2022Updated 3 years ago
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,800Dec 12, 2023Updated 2 years ago
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆273Apr 15, 2023Updated 2 years ago
- ☆918Jul 24, 2024Updated last year
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,229Mar 10, 2024Updated 2 years ago
- [EMNLP 2022] Unifying and multi-tasking structured knowledge grounding with language models☆569Aug 22, 2023Updated 2 years ago
- This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"☆1,626Jun 12, 2023Updated 2 years ago
- GLM (General Language Model)☆3,457Nov 3, 2023Updated 2 years ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,587Mar 27, 2023Updated 2 years ago
- GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)☆7,664Jul 25, 2023Updated 2 years ago
- [NIPS2023] RRHF & Wombat☆808Sep 22, 2023Updated 2 years ago
- Paper List for In-context Learning 🌷☆872Oct 8, 2024Updated last year