yangheng95 / InstOptima

Related projects ⓘ

Alternatives and complementary repositories for InstOptima

• srzer / MOD
  Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".
  ☆13Updated last week
• tianjunz / TEMPERA
  ☆41Updated last year
• shizhediao / Black-Box-Prompt-Learning
  Source code for the TMLR paper "Black-Box Prompt Learning for Pre-trained Language Models"
  ☆55Updated last year
• MaHuanAAA / g_fair_prompting
  ☆31Updated last year
• ECNU-ICALK / BPT-VLM
  [IJCAI 2023] Black-box Prompt Tuning for Vision-Language Model as a Service
  ☆15Updated last year
• holarissun / Prompt-OIRL
  code for paper Query-Dependent Prompt Evaluation and Optimization with Offline Inverse Reinforcement Learning
  ☆32Updated 7 months ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆23Updated 10 months ago
• ChnQ / TracingLLM
  ☆23Updated 5 months ago
• keven980716 / weak-to-strong-deception
  Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"
  ☆10Updated 4 months ago
• erosenfeld / disagree_discrep
  Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.
  ☆9Updated 8 months ago
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆29Updated 2 weeks ago
• jys5609 / GPT-Critic
  GPT-Critic: Offline Reinforcement Learning for End-to-End Task-Oriented Dialogue Systems
  ☆10Updated 2 years ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆18Updated 8 months ago
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆29Updated 8 months ago
• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆50Updated last year
• YangRui2015 / RiC
  Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"
  ☆47Updated last week
• princeton-nlp / unintentional-unalignment
  Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆13Updated 3 weeks ago
• swaggy-TN / EfficientVLM
  EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning (ACL 2023)
  ☆20Updated last year
• Pranjal2041 / AdaptiveConsistency
  Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs
  ☆31Updated 9 months ago
• lingchen0331 / UQ_ICL
  Uncertainty quantification for in-context learning of large language models
  ☆12Updated 7 months ago
• zzz47zzz / codebase-for-incremental-learning-with-llm
  [ACL2024] A Codebase for Incremental Learning with Large Language Models; Official released code for "Learn or Recall? Revisiting Increme…
  ☆20Updated 3 weeks ago
• Linear95 / DSP
  Domain-specific preference (DSP) data and customized RM fine-tuning.
  ☆24Updated 8 months ago
• princeton-nlp / benign-data-breaks-safety
  ☆19Updated last month
• which47 / LLMCL
  Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
  ☆22Updated 3 months ago
• YangRui2015 / Generalizable-Reward-Model
  Code for NeurIPS 2024 paper "Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs" (under preparation)
  ☆13Updated this week
• ECNU-ICALK / MELO
  [AAAI 2024] MELO: Enhancing Model Editing with Neuron-indexed Dynamic LoRA
  ☆21Updated 7 months ago
• wuxingyu-ai / LLM4EC
  A list of awesome papers and resources of the intersection of Large Language Models and Evolutionary Computation.
  ☆34Updated 5 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆15Updated last year
• ZHZisZZ / modpo
  [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
  ☆52Updated 2 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆49Updated 2 weeks ago