cmnfriend / O-LoRA
☆147Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for O-LoRA
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆230Updated 6 months ago
- ☆116Updated 3 months ago
- [SIGIR'24] The official implementation code of MOELoRA.☆124Updated 3 months ago
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆59Updated 9 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆23Updated last month
- ☆154Updated last month
- ☆76Updated 4 months ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆275Updated last year
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆153Updated 9 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆29Updated 7 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆100Updated 2 weeks ago
- ☆71Updated 10 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆144Updated 5 months ago
- Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"☆285Updated 4 months ago
- ☆22Updated 2 weeks ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆73Updated 8 months ago
- Continual Learning of Large Language Models: A Comprehensive Survey☆252Updated last week
- A RLHF Infrastructure for Vision-Language Models☆104Updated this week
- A Survey on the Honesty of Large Language Models☆46Updated last month
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆145Updated 5 months ago
- ☆14Updated 5 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆125Updated 2 months ago
- This repository collects awesome survey, resource, and paper for Lifelong Learning for Large Language Models. (Updated Regularly)☆31Updated 2 weeks ago
- [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models☆69Updated 8 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆235Updated 2 months ago
- Released code for our ICLR23 paper.☆63Updated last year
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆102Updated 2 months ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆58Updated 11 months ago
- Must-read Papers on Large Language Model (LLM) Continual Learning☆134Updated last year