allen4747 / FerretLinks
This is the official implementation for the paper: Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
☆13Updated 8 months ago
Alternatives and similar repositories for Ferret
Users that are interested in Ferret are comparing it to the libraries listed below
Sorting:
- ☆27Updated last month
- ☆17Updated 5 months ago
- [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely☆23Updated 11 months ago
- Implementation for PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs☆22Updated last year
- ☆15Updated 7 months ago
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Updated 10 months ago
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆38Updated 7 months ago
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆39Updated last year
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆27Updated 3 months ago
- Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆15Updated 2 months ago
- Exploring Model Kinship for Merging Large Language Models☆24Updated last month
- ICLR 2025☆26Updated 2 weeks ago
- A block pruning framework for LLMs.☆23Updated 3 weeks ago
- ☆19Updated 3 months ago
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆26Updated 7 months ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆69Updated 3 months ago
- ☆37Updated 7 months ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆21Updated 5 months ago
- Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More☆31Updated 3 weeks ago
- [ACL 2025] Knowledge Unlearning for Large Language Models☆34Updated last month
- Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆82Updated 6 months ago
- Control LLM☆14Updated 2 months ago
- A curated list of Model Merging methods.☆92Updated 8 months ago
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆47Updated last year
- The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".☆70Updated 2 months ago
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆61Updated 2 months ago
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆42Updated last year
- Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"☆28Updated last year
- ☆79Updated 4 months ago
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆37Updated last year