A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
☆1,039Sep 19, 2024Updated last year
Alternatives and similar repositories for OpenDelta
Users that are interested in OpenDelta are comparing it to the libraries listed below
Sorting:
- An Open-Source Framework for Prompt-Learning.☆4,828Jul 16, 2024Updated last year
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆285Jun 27, 2023Updated 2 years ago
- Must-read papers on prompt-based tuning for pre-trained language models.☆4,295Jul 17, 2023Updated 2 years ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learning☆2,801Oct 12, 2025Updated 4 months ago
- Efficient Training (including pre-training and fine-tuning) for Big Models☆621Oct 27, 2025Updated 4 months ago
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆543Mar 24, 2022Updated 3 years ago
- ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Model…☆271Nov 8, 2022Updated 3 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆475Mar 7, 2024Updated last year
- Live Training for Open-source Big Models☆505May 30, 2023Updated 2 years ago
- Efficient Inference for Big Models☆587Jan 24, 2023Updated 3 years ago
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆958Apr 26, 2024Updated last year
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,641Oct 16, 2024Updated last year
- Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)☆2,789Mar 13, 2024Updated last year
- A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.☆938Oct 6, 2022Updated 3 years ago
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,766Aug 4, 2024Updated last year
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,678Updated this week
- A modular RL library to fine-tune language models to human preferences☆2,378Mar 1, 2024Updated last year
- PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"☆242Jan 20, 2023Updated 3 years ago
- An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks☆2,076Nov 16, 2023Updated 2 years ago
- Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration 🚃☆116Oct 27, 2022Updated 3 years ago
- ☆399Oct 12, 2021Updated 4 years ago
- ☆917Jul 24, 2024Updated last year
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,798Dec 12, 2023Updated 2 years ago
- Toolkit for creating, sharing and using natural language prompts.☆2,996Oct 23, 2023Updated 2 years ago
- [NIPS2023] RRHF & Wombat☆809Sep 22, 2023Updated 2 years ago
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,230Mar 10, 2024Updated last year
- ☆1,560Feb 20, 2026Updated last week
- Efficient, Low-Resource, Distributed transformer implementation based on BMTrain☆267Nov 27, 2023Updated 2 years ago
- Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins☆2,786Dec 5, 2023Updated 2 years ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,576Mar 27, 2023Updated 2 years ago
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆730Aug 29, 2022Updated 3 years ago
- GLM (General Language Model)☆3,437Nov 3, 2023Updated 2 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,435Mar 20, 2024Updated last year
- Expanding natural instructions☆1,035Dec 11, 2023Updated 2 years ago
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,611Aug 30, 2023Updated 2 years ago
- This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"☆1,628Jun 12, 2023Updated 2 years ago
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆273Apr 15, 2023Updated 2 years ago
- Example models using DeepSpeed☆6,785Feb 7, 2026Updated 3 weeks ago
- Model Compression for Big Models☆168Jun 30, 2023Updated 2 years ago