Alternatives and similar repositories for OpenDelta:

Users that are interested in OpenDelta are comparing it to the libraries listed below

• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆929Updated 2 years ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆919Updated 11 months ago
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆524Updated 3 years ago
• THUDM / P-tuning-v2
  An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
  ☆2,030Updated last year
• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆283Updated last year
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,151Updated last year
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,619Updated last year
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆582Updated 8 months ago
• dqxiu / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆853Updated 6 months ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆806Updated last year
• thunlp / ToolLearningPapers
  ☆899Updated 8 months ago
• RenzeLou / awesome-instruction-learning
  Papers and Datasets on Instruction Tuning and Following. ✨✨✨
  ☆488Updated last year
• WeOpenML / PandaLM
  ☆910Updated 10 months ago
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆766Updated last year
• PhoebusSi / Alpaca-CoT
  We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…
  ☆2,732Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆415Updated 7 months ago
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,356Updated last year
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆729Updated 2 years ago
• ruixiangcui / AGIEval
  ☆748Updated 10 months ago
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆280Updated last year
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆251Updated last year
• THUDM / SwissArmyTransformer
  SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
  ☆1,073Updated 3 months ago
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,071Updated 8 months ago
• beyondguo / LLM-Tuning
  Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.
  ☆993Updated 11 months ago
• HillZhang1999 / llm-hallucination-survey
  Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …
  ☆1,010Updated 4 months ago
• itsnamgyu / reasoning-teacher
  Large Language Models Are Reasoning Teachers (ACL 2023)
  ☆329Updated last month
• XueFuzhao / InstructionWild
  ☆459Updated 10 months ago
• pfliu-nlp / NLPedia-Pretrain
  ☆396Updated 3 years ago
• adapter-hub / adapters
  A Unified Library for Parameter-Efficient and Modular Transfer Learning
  ☆2,683Updated this week
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,382Updated last year