PKU-ML / LongPPL

Related projects ⓘ

Alternatives and complementary repositories for LongPPL

• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆14Updated 6 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆39Updated last month
• sail-sg / Attention-Sink
  [ATTRIB @ NeurIPS 2024] When Attention Sink Emerges in Language Models: An Empirical View
  ☆27Updated 3 weeks ago
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆20Updated 6 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆67Updated last month
• ADaM-BJTU / W2SG
  The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”
  ☆15Updated 8 months ago
• shizhediao / Black-Box-Prompt-Learning
  Source code for the TMLR paper "Black-Box Prompt Learning for Pre-trained Language Models"
  ☆55Updated last year
• princeton-nlp / benign-data-breaks-safety
  ☆19Updated last month
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆15Updated 5 months ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆44Updated 10 months ago
• Unispac / shallow-vs-deep-alignment
  Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  ☆26Updated 4 months ago
• tatsu-lab / test_set_contamination
  ☆33Updated last year
• dannyallover / overthinking_the_truth
  ☆26Updated 6 months ago
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆63Updated last year
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆63Updated 9 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆24Updated 2 months ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆25Updated 6 months ago
• adymaharana / d2pruning
  ☆31Updated last year
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆15Updated last year
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆83Updated 5 months ago
• TRAIS-Lab / dattri
  `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.
  ☆31Updated last week
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆34Updated 2 weeks ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆33Updated this week
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆26Updated 7 months ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆69Updated 8 months ago
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆68Updated 3 weeks ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆18Updated 8 months ago
• MadryLab / DsDm
  ☆43Updated 9 months ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆24Updated 8 months ago