A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
☆1,044Sep 19, 2024Updated last year
Alternatives and similar repositories for OpenDelta
Users that are interested in OpenDelta are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An Open-Source Framework for Prompt-Learning.☆4,865Jul 16, 2024Updated last year
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆285Jun 27, 2023Updated 2 years ago
- Must-read papers on prompt-based tuning for pre-trained language models.☆4,301Jul 17, 2023Updated 2 years ago
- Efficient Training (including pre-training and fine-tuning) for Big Models☆624Apr 23, 2026Updated 3 weeks ago
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆544Mar 24, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A Unified Library for Parameter-Efficient and Modular Transfer Learning☆2,812Apr 26, 2026Updated 3 weeks ago
- ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Model…☆272Nov 8, 2022Updated 3 years ago
- Live Training for Open-source Big Models☆501May 30, 2023Updated 2 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆476Mar 7, 2024Updated 2 years ago
- Awesome papers on Language-Model-as-a-Service (LMaaS)☆545May 14, 2024Updated 2 years ago
- Efficient Inference for Big Models☆584Jan 24, 2023Updated 3 years ago
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆962Apr 26, 2024Updated 2 years ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,651Oct 16, 2024Updated last year
- Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)☆2,842Mar 13, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.☆939Oct 6, 2022Updated 3 years ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆21,138May 13, 2026Updated last week
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,773Aug 4, 2024Updated last year
- PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"☆241Jan 20, 2023Updated 3 years ago
- A modular RL library to fine-tune language models to human preferences☆2,387Mar 1, 2024Updated 2 years ago
- An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks☆2,077Nov 16, 2023Updated 2 years ago
- ☆401Oct 12, 2021Updated 4 years ago
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆728Aug 29, 2022Updated 3 years ago
- Model Compression for Big Models☆169Jun 30, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins☆2,776Dec 5, 2023Updated 2 years ago
- Efficient, Low-Resource, Distributed transformer implementation based on BMTrain☆270Nov 27, 2023Updated 2 years ago
- Toolkit for creating, sharing and using natural language prompts.☆3,015Oct 23, 2023Updated 2 years ago
- ☆131Aug 18, 2022Updated 3 years ago
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,797Dec 12, 2023Updated 2 years ago
- Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration 🚃☆117Oct 27, 2022Updated 3 years ago
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆274Apr 15, 2023Updated 3 years ago
- ☆920Jul 24, 2024Updated last year
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,234Mar 10, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [EMNLP 2022] Unifying and multi-tasking structured knowledge grounding with language models☆565Aug 22, 2023Updated 2 years ago
- This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"☆1,626Jun 12, 2023Updated 2 years ago
- GLM (General Language Model)☆3,496Nov 3, 2023Updated 2 years ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,600Mar 27, 2023Updated 3 years ago
- GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)☆7,651Jul 25, 2023Updated 2 years ago
- [NIPS2023] RRHF & Wombat☆806Sep 22, 2023Updated 2 years ago
- Paper List for In-context Learning 🌷☆875Oct 8, 2024Updated last year