CERT-Lab / lora-sb
Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
☆44Updated 3 weeks ago
Alternatives and similar repositories for lora-sb:
Users that are interested in lora-sb are comparing it to the libraries listed below
- What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆63Updated last week
- (CVPR 2025) Official implementation to DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation which outperforms SOTA…☆19Updated last week
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆119Updated 6 months ago
- Official repository for Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning [ICLR 2025]☆41Updated last month
- [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?☆67Updated last month
- Official Code for paper "Towards Efficient and Effective Unlearning of Large Language Models for Recommendation" (Frontiers of Computer S…☆36Updated 7 months ago
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆108Updated 10 months ago
- This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM☆57Updated 9 months ago
- Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models☆34Updated 5 months ago
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆84Updated 9 months ago
- ☆73Updated 6 months ago
- The first dense retrieval model that can be prompted like an LM☆66Updated 5 months ago
- Code associated with the EMNLP 2024 Main paper: "Image, tell me your story!" Predicting the original meta-context of visual misinformatio…☆36Updated 2 weeks ago
- Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆112Updated last month
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆53Updated 10 months ago
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆204Updated last week
- HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models☆38Updated 3 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆159Updated 2 months ago
- Code & Dataset for Paper: "Distill Visual Chart Reasoning Ability from LLMs to MLLMs"☆51Updated 4 months ago
- ☆37Updated 5 months ago
- ☆16Updated 2 months ago
- This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.☆102Updated 8 months ago
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆74Updated 5 months ago
- Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆35Updated last month