This repository contains the implementation of the paper "MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models".
☆24May 28, 2025Updated 9 months ago
Alternatives and similar repositories for meteora
Users that are interested in meteora are comparing it to the libraries listed below
Sorting:
- ☆13Mar 8, 2024Updated 2 years ago
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆57Aug 25, 2024Updated last year
- ☆26Nov 23, 2023Updated 2 years ago
- On the Effectiveness of Parameter-Efficient Fine-Tuning☆38Nov 4, 2023Updated 2 years ago
- [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…☆11Nov 28, 2023Updated 2 years ago
- Bayesian low-rank adaptation for large language models☆28May 4, 2024Updated last year
- ☆11Nov 13, 2024Updated last year
- Code for "Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning" (EMNLP 2022) and "Empowering Parameter-Efficient Transfer Learning…☆11Feb 6, 2023Updated 3 years ago
- Source code for SIGIR 2022 paper.☆16Apr 25, 2022Updated 3 years ago
- Building modular LMs with parameter-efficient fine-tuning.☆115Jan 18, 2026Updated 2 months ago
- Papers of Implicit Reasoning in LLMs.☆24Mar 13, 2025Updated last year
- vad☆25Apr 3, 2023Updated 2 years ago
- ☆13Oct 15, 2022Updated 3 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆15Jun 15, 2021Updated 4 years ago
- ☆21Mar 7, 2024Updated 2 years ago
- Code for PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization, NeurIPS 2022☆19Nov 23, 2022Updated 3 years ago
- An inequality benchmark for theorem proving☆22Feb 1, 2026Updated last month
- ☆37Apr 16, 2021Updated 4 years ago
- PyTorch implementation of Language model compression with weighted low-rank factorization☆13Jun 28, 2023Updated 2 years ago
- ☆14Apr 16, 2024Updated last year
- ☆20Jul 5, 2024Updated last year
- (ECCV 2024) Official repository of paper "Bridge Past and Future: Overcoming Information Asymmetry in Incremental Object Detection"☆21Mar 26, 2025Updated 11 months ago
- [ACL2023] Source code for Decouple knowledge from paramters for plug-and-play language modeling☆20Sep 18, 2023Updated 2 years ago
- Learning adapter weights from task descriptions☆19Nov 12, 2023Updated 2 years ago
- ☆11Jun 5, 2024Updated last year
- [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…☆15Oct 18, 2022Updated 3 years ago
- ☆21Jan 25, 2023Updated 3 years ago
- ☆21Jun 11, 2024Updated last year
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆21Oct 15, 2024Updated last year
- An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆36Jun 7, 2024Updated last year
- In this playground competition, you are provided a strictly canine subset of ImageNet in order to practice fine-grained image categorizat…☆11Dec 10, 2020Updated 5 years ago
- Code for ACL2022 publication Transkimmer: Transformer Learns to Layer-wise Skim☆22Aug 21, 2022Updated 3 years ago
- ☆21Jun 25, 2023Updated 2 years ago
- This repository provides code for the paper ---- On Universal Black-Box Domain Adaptation.☆10Sep 2, 2021Updated 4 years ago
- This is an official implementation of our work, Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on V…☆16Sep 24, 2025Updated 5 months ago
- Evaluating Durability: Benchmark Insights into Multimodal Watermarking☆12Jun 7, 2024Updated last year
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training☆676Updated this week
- [MLHC 2021] Model Selection for Offline RL: Practical Considerations for Healthcare Settings. https://arxiv.org/abs/2107.11003☆10Oct 6, 2022Updated 3 years ago
- ☆32Feb 4, 2026Updated last month