Alternatives and similar repositories for llm_depth_pruning:

Users that are interested in llm_depth_pruning are comparing it to the libraries listed below

• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆31Updated 8 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆39Updated 3 months ago
• duykhuongnguyen / LASeR-MAB
  Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"
  ☆13Updated 3 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆48Updated last year
• yale-nlp / refdpo
  ☆15Updated 5 months ago
• formll / resolving-scaling-law-discrepancies
  ☆16Updated 6 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆22Updated 9 months ago
• stan-anony / derivative_free_lora_rank
  ☆15Updated 11 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 7 months ago
• LukasHedegaard / structured-pruning-adapters
  Structured Pruning Adapters in PyTorch
  ☆16Updated last year
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆29Updated last year
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆16Updated last month
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• VITA-Group / Data-Efficient-Scaling
  [ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang
  ☆13Updated last year
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 3 months ago
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆20Updated 6 months ago
• wangxu0820 / NegativePrompt
  The official GitHub page for paper "NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional St…
  ☆19Updated 8 months ago
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆11Updated 4 months ago
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated 10 months ago
• DRSY / KV_Compression
  [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens
  ☆22Updated last year
• joonkeekim / Instructive-Decoding
  Official repository of "Distort, Distract, Decode: Instruction-Tuned Model Can Refine its Response from Noisy Instructions", ICLR 2024 Sp…
  ☆20Updated 10 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• sanagno / adaptively_sparse_attention
  ☆18Updated last year
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆38Updated last year
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆37Updated last month
• ctlllll / reward_collapse
  ☆26Updated last year
• IST-DASLab / RoSA
  ☆38Updated 10 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs?
  ☆26Updated 7 months ago
• googleinterns / localizing-paragraph-memorization
  ☆14Updated 10 months ago