Alternatives and similar repositories for DPZero

Users that are interested in DPZero are comparing it to the libraries listed below

• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• Princeton-SysML / kNNLM_privacy
  Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888
  ☆35Updated 11 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated last month
• yaojin17 / Unlearning_LLM
  [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"
  ☆57Updated 8 months ago
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆36Updated last year
• microsoft / dp-few-shot-generation
  ☆26Updated last year
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆31Updated last year
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆23Updated last year
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆23Updated 11 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆44Updated 4 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆31Updated 7 months ago
• formll / resolving-scaling-law-discrepancies
  ☆19Updated 10 months ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆104Updated 11 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆45Updated 7 months ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆27Updated last year
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆18Updated last year
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆35Updated 7 months ago
• Model-GLUE / Model-GLUE
  ☆15Updated 9 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆63Updated last week
• zjysteven / mink-plus-plus
  [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs
  ☆37Updated last week
• dunzeng / MORE
  Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment
  ☆16Updated 10 months ago
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 2 years ago
• WANGXinyiLinda / planning_tokens
  Official code for Guiding Language Model Math Reasoning with Planning Tokens
  ☆11Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆92Updated 8 months ago
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆14Updated 9 months ago
• uservan / ThinkPO
  ☆19Updated 3 months ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆45Updated 2 years ago
• Leiay / looped_transformer
  ☆26Updated last year
• MadryLab / DsDm
  ☆48Updated last year
• adymaharana / d2pruning
  ☆35Updated last year