Alternatives and similar repositories for IncreLoRA:

Users that are interested in IncreLoRA are comparing it to the libraries listed below

• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆36Updated 10 months ago
• r-three / smear
  ☆28Updated last year
• ShiZhengyan / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆97Updated last year
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆29Updated 8 months ago
• adymaharana / d2pruning
  ☆35Updated last year
• MrGGLS / BlockPruner
  A block pruning framework for LLMs.
  ☆22Updated 9 months ago
• Infini-AI-Lab / S2FT
  ☆16Updated 3 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆56Updated last month
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆48Updated last month
• declare-lab / della
  DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling
  ☆29Updated 9 months ago
• SempraETY / Pruning-via-Merging
  ☆18Updated 4 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 6 months ago
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆30Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆49Updated 2 years ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆37Updated 6 months ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆39Updated last year
• tanganke / weight-ensembling_MoE
  Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
  ☆23Updated 10 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆77Updated 5 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆25Updated 4 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆26Updated last month
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 9 months ago
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆67Updated last year
• tianyi-lab / Mosaic-IT
  Mosaic IT: Enhancing Instruction Tuning with Data Mosaics
  ☆17Updated 2 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆36Updated 9 months ago
• shawnricecake / Heima
  Code for Heima
  ☆40Updated 2 months ago
• VijayLingam95 / SVFT
  ☆27Updated 2 months ago
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆49Updated 11 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆111Updated last week
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆36Updated last year
• prateeky2806 / ties-merging
  ☆173Updated last year