formll / resolving-scaling-law-discrepancies

Related projects ⓘ

Alternatives and complementary repositories for resolving-scaling-law-discrepancies

• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs?
  ☆25Updated 5 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆13Updated this week
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated 8 months ago
• ctlllll / reward_collapse
  ☆26Updated last year
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆11Updated 2 months ago
• wang-kee / LiNeS
  ☆22Updated 2 weeks ago
• qcznlp / uncertainty_attack
  ☆12Updated 2 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆18Updated last month
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 7 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆31Updated last month
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆14Updated 5 months ago
• activatedgeek / calibration-tuning
  ☆36Updated 3 months ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆30Updated 3 months ago
• googleinterns / localizing-paragraph-memorization
  ☆14Updated 9 months ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆18Updated 2 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆48Updated 7 months ago
• yale-nlp / refdpo
  ☆15Updated 3 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆50Updated last month
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 3 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆15Updated 5 months ago
• epfml / schedules-and-scaling
  ☆53Updated 3 weeks ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆39Updated 3 months ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆23Updated 3 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆30Updated 6 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆33Updated last month
• clemneo / llava-interp
  ☆15Updated 2 weeks ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆26Updated 11 months ago
• terarachang / DataICL
  Data Valuation on In-Context Examples (ACL23)
  ☆23Updated last month
• dunzeng / MORE
  Code for paper - On Diversified Preferences of Large Language Model Alignment
  ☆14Updated 3 months ago