Alternatives and similar repositories for OpenDelta:

Users that are interested in OpenDelta are comparing it to the libraries listed below

• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆928Updated 2 years ago
• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆281Updated last year
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆799Updated last year
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆910Updated 9 months ago
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,127Updated 11 months ago
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆522Updated 2 years ago
• dqxiu / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆836Updated 4 months ago
• THUDM / P-tuning-v2
  An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
  ☆2,006Updated last year
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,059Updated 6 months ago
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆575Updated 6 months ago
• thunlp / ToolLearningPapers
  ☆889Updated 6 months ago
• WeOpenML / PandaLM
  ☆903Updated 8 months ago
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,618Updated last year
• HillZhang1999 / llm-hallucination-survey
  Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …
  ☆981Updated 3 months ago
• RenzeLou / awesome-instruction-learning
  Papers and Datasets on Instruction Tuning and Following. ✨✨✨
  ☆481Updated 10 months ago
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆760Updated last year
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆546Updated last year
• Timothyxxx / Chain-of-ThoughtsPapers
  A trend starts from "Chain of Thought Prompting Elicits Reasoning in Large Language Models".
  ☆2,004Updated last year
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,318Updated 11 months ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆411Updated 5 months ago
• XueFuzhao / InstructionWild
  ☆456Updated 8 months ago
• beyondguo / LLM-Tuning
  Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.
  ☆984Updated 9 months ago
• pfliu-nlp / NLPedia-Pretrain
  ☆396Updated 3 years ago
• PhoebusSi / Alpaca-CoT
  We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…
  ☆2,687Updated last year
• allenai / natural-instructions
  Expanding natural instructions
  ☆975Updated last year
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆922Updated 2 months ago
• PKU-Alignment / safe-rlhf
  Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
  ☆1,413Updated 8 months ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆644Updated last year
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆246Updated last year
• Doragd / Awesome-Sentence-Embedding
  A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.
  ☆312Updated last year