Applied-Machine-Learning-Lab / MOELoRA-peft
[SIGIR'24] The official implementation code of MOELoRA.
☆30Updated 8 months ago
Alternatives and similar repositories for MOELoRA-peft:
Users that are interested in MOELoRA-peft are comparing it to the libraries listed below
- [SIGIR'24] The official implementation code of MOELoRA.☆160Updated 9 months ago
- ☆27Updated last year
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆19Updated 2 months ago
- Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)☆18Updated 8 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆34Updated 3 months ago
- Official Code and data for ACL 2024 finding, "An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models"☆19Updated 5 months ago
- ☆132Updated 9 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆35Updated last year
- [ACL 2024] Learning to Edit: Aligning LLMs with Knowledge Editing☆35Updated 8 months ago
- Code for "Retaining Key Information under High Compression Rates: Query-Guided Compressor for LLMs" (ACL 2024)☆17Updated 10 months ago
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)☆46Updated last month
- ☆172Updated 9 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆118Updated 5 months ago
- Source code of ACL 2023 accepted paper "AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression"☆11Updated last year
- An implementation of SEAL: Safety-Enhanced Aligned LLM fine-tuning via bilevel data selection.☆12Updated 2 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆188Updated 4 months ago
- ☆26Updated 3 months ago
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"☆112Updated 7 months ago
- This repository collects awesome survey, resource, and paper for Lifelong Learning for Large Language Models. (Updated Regularly)☆46Updated 2 months ago
- [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"☆44Updated 4 months ago
- ☆71Updated last year
- [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models☆75Updated last year
- Official implementation of the ICLR paper "Streamlining Redundant Layers to Compress Large Language Models"☆22Updated last week
- A block pruning framework for LLMs.☆22Updated 10 months ago
- [ACL-2024]Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training☆25Updated 5 months ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆42Updated 3 weeks ago
- Released code and datas for「Multi-modal Stance Detection: New Datasets and Model」in ACL2024.☆20Updated 10 months ago
- [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$☆43Updated 6 months ago
- This is the repo for the survey of Bias and Fairness in IR with LLMs.☆52Updated 3 weeks ago
- ☆99Updated 9 months ago