Alternatives and similar repositories for DPZero

Users that are interested in DPZero are comparing it to the libraries listed below

• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆92Updated 10 months ago
• Princeton-SysML / kNNLM_privacy
  Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888
  ☆36Updated last year
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 2 years ago
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆59Updated 2 weeks ago
• yaojin17 / Unlearning_LLM
  [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"
  ☆59Updated 10 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 3 months ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• daeveraert / gradient-information-optimization
  Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection
  ☆14Updated 2 years ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆46Updated 10 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆32Updated 9 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆53Updated 2 years ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆28Updated last year
• Model-GLUE / Model-GLUE
  ☆15Updated 11 months ago
• MadryLab / DsDm
  ☆50Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• mmatena / model_merging
  ☆71Updated 3 years ago
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆30Updated last year
• r-three / smear
  ☆30Updated last year
• locuslab / acr-memorization
  ☆35Updated 7 months ago
• orionw / Multilingual-Federated-Learning
  Code for the paper "Pretrained Models for Multilingual Federated Learning" at NAACL 2022
  ☆11Updated 3 years ago
• Princeton-SysML / FILM
  Official repo for the paper: Recovering Private Text in Federated Learning of Language Models (in NeurIPS 2022)
  ☆58Updated 2 years ago
• uservan / ThinkPO
  ☆18Updated last week
• tanganke / weight-ensembling_MoE
  Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
  ☆29Updated last year
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆81Updated last year
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆23Updated last year
• yxli2123 / LoSparse
  ☆59Updated last year
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆107Updated last month
• WANGXinyiLinda / concept-based-demonstration-selection
  Offical code of the paper Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Le…
  ☆75Updated last year
• JJchy / CG_score
  Data Valuation without Training of a Model, submitted to ICLR'23
  ☆22Updated 2 years ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆109Updated last month