Alternatives and similar repositories for OpenDelta

Users that are interested in OpenDelta are comparing it to the libraries listed below

• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆286Updated last year
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆534Updated 3 years ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆933Updated last year
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆934Updated 2 years ago
• dqxiu / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆854Updated 8 months ago
• THUDM / P-tuning-v2
  An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
  ☆2,042Updated last year
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,180Updated last year
• thunlp / ToolLearningPapers
  ☆904Updated 10 months ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆808Updated last year
• WeOpenML / PandaLM
  ☆916Updated last year
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,374Updated last year
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,073Updated 10 months ago
• PKU-Alignment / safe-rlhf
  Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
  ☆1,491Updated last year
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆596Updated 3 weeks ago
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆768Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆415Updated 9 months ago
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,618Updated last year
• HillZhang1999 / llm-hallucination-survey
  Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …
  ☆1,021Updated 7 months ago
• pfliu-nlp / NLPedia-Pretrain
  ☆396Updated 3 years ago
• kojima-takeshi188 / zero_shot_cot
  Prod Env
  ☆423Updated last year
• RenzeLou / awesome-instruction-learning
  Papers and Datasets on Instruction Tuning and Following. ✨✨✨
  ☆499Updated last year
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆967Updated 6 months ago
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆563Updated last year
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆728Updated 2 years ago
• Timothyxxx / Chain-of-ThoughtsPapers
  A trend starts from "Chain of Thought Prompting Elicits Reasoning in Large Language Models".
  ☆2,043Updated last year
• beyondguo / LLM-Tuning
  Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.
  ☆1,005Updated last year
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆331Updated 2 years ago
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆256Updated last year
• GaryYufei / AlignLLMHumanSurvey
  Aligning Large Language Models with Human: A Survey
  ☆730Updated last year
• FreedomIntelligence / InstructionZoo
  ☆281Updated last year