thunlp / OpenDelta

Related projects ⓘ

Alternatives and complementary repositories for OpenDelta

• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆923Updated 2 years ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆896Updated 6 months ago
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆516Updated 2 years ago
• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆277Updated last year
• dqxiu / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆818Updated last month
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆798Updated last year
• THUDM / P-tuning-v2
  An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
  ☆1,985Updated last year
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,079Updated 8 months ago
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆564Updated 3 months ago
• RenzeLou / awesome-instruction-learning
  Papers and Datasets on Instruction Tuning and Following. ✨✨✨
  ☆459Updated 7 months ago
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,031Updated 3 months ago
• WeOpenML / PandaLM
  ☆891Updated 5 months ago
• thunlp / ToolLearningPapers
  ☆875Updated 3 months ago
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,607Updated last year
• Doragd / Awesome-Sentence-Embedding
  A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.
  ☆302Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆411Updated 2 months ago
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆242Updated 11 months ago
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆756Updated last year
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆275Updated last year
• HillZhang1999 / llm-hallucination-survey
  Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …
  ☆941Updated 2 months ago
• OpenLMLab / MOSS-RLHF
  MOSS-RLHF
  ☆1,292Updated 8 months ago
• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆822Updated 2 years ago
• XueFuzhao / InstructionWild
  ☆453Updated 5 months ago
• ruixiangcui / AGIEval
  ☆708Updated 5 months ago
• GaryYufei / AlignLLMHumanSurvey
  Aligning Large Language Models with Human: A Survey
  ☆700Updated last year
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆657Updated 5 months ago
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆721Updated 2 years ago
• Timothyxxx / Chain-of-ThoughtsPapers
  A trend starts from "Chain of Thought Prompting Elicits Reasoning in Large Language Models".
  ☆1,956Updated last year
• pfliu-nlp / NLPedia-Pretrain
  ☆394Updated 3 years ago
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆883Updated 4 months ago