allen4747 / FerretLinks
This is the official implementation for the paper: Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
☆13Updated 9 months ago
Alternatives and similar repositories for Ferret
Users that are interested in Ferret are comparing it to the libraries listed below
Sorting:
- ☆17Updated 5 months ago
- ☆29Updated 2 months ago
- Official code for Guiding Language Model Math Reasoning with Planning Tokens☆13Updated last year
- A block pruning framework for LLMs.☆23Updated last month
- [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely☆23Updated last year
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆29Updated 7 months ago
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆27Updated 4 months ago
- ☆15Updated 7 months ago
- Exploring Model Kinship for Merging Large Language Models☆24Updated 2 months ago
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆39Updated last year
- Implementation for PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs☆23Updated last year
- [ACL 2025] Knowledge Unlearning for Large Language Models☆37Updated last month
- ☆19Updated 4 months ago
- ☆58Updated last week
- ☆33Updated last year
- [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"☆59Updated 8 months ago
- A curated list of Model Merging methods.☆92Updated 9 months ago
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆38Updated 8 months ago
- Control LLM☆16Updated 2 months ago
- ☆17Updated 7 months ago
- ☆18Updated 7 months ago
- Codes for Merging Large Language Models☆32Updated 10 months ago
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆61Updated last year
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆31Updated last year
- ☆29Updated 4 months ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 9 months ago
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated 2 months ago
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆56Updated 10 months ago
- Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888☆35Updated last year
- [ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆84Updated 7 months ago