Chaos96 / fourierft
☆142Updated 6 months ago
Alternatives and similar repositories for fourierft:
Users that are interested in fourierft are comparing it to the libraries listed below
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆130Updated last month
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆175Updated 3 months ago
- ☆182Updated 5 months ago
- ☆100Updated 8 months ago
- ☆127Updated 8 months ago
- [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models☆72Updated last year
- ☆189Updated last year
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆55Updated last month
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆149Updated 7 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆106Updated last week
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆37Updated 5 months ago
- A curated list of Model Merging methods.☆91Updated 6 months ago
- Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"☆123Updated 10 months ago
- [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆74Updated 9 months ago
- Survey on Data-centric Large Language Models☆80Updated 8 months ago
- ☆19Updated 10 months ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆63Updated 11 months ago
- Awesome-Low-Rank-Adaptation☆83Updated 5 months ago
- ☆170Updated 8 months ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆132Updated 3 weeks ago
- [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models☆43Updated 4 months ago
- Paper List of Inference/Test Time Scaling/Computing☆127Updated this week
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆98Updated last week
- 🚀LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training☆73Updated 3 months ago
- A repository for DenseSSMs☆87Updated 11 months ago
- AnchorAttention: Improved attention for LLMs long-context training☆206Updated 2 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆306Updated 10 months ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆28Updated 11 months ago
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)☆44Updated 2 weeks ago
- [SIGIR'24] The official implementation code of MOELoRA.☆153Updated 8 months ago