junzhang-zj / LoRAM
[ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models
☆70Updated last month
Alternatives and similar repositories for LoRAM:
Users that are interested in LoRAM are comparing it to the libraries listed below
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆215Updated 6 months ago
- ☆106Updated 9 months ago
- ☆87Updated 3 weeks ago
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆240Updated 6 months ago
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆119Updated last month
- Official Repository of paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆147Updated 2 months ago
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆107Updated 3 months ago
- Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs).☆147Updated last week
- Pytorch Implementation of "Sinkhorn Distance Minimization for Knowledge Distillation", COLING 2024 and TNNLS 2024☆121Updated last week
- MM-IFEngine: Towards Multimodal Instruction Following☆80Updated last week
- ☆116Updated 10 months ago
- Official code for "🔍 Retrieval Models Aren’t Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models"☆169Updated last month
- This repository is the official implementation of "DTL: Disentangled Transfer Learning for Visual Recognition", which is accepted by AAAI…☆112Updated last year
- [NeurIPS'24] "Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration"☆181Updated last month
- [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.☆190Updated 7 months ago
- PyTorch implementation of the paper : Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation.☆49Updated 9 months ago
- [ICML 2024] JSQ: Compressing Large Language Models by Joint Sparsification and Quantization☆149Updated 6 months ago
- ☆203Updated 5 months ago
- [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation☆167Updated 2 months ago
- Teaching LMMs for Image Quality Scoring and Interpreting☆89Updated last month
- [CVPR 2025] A benchmark for video quality understanding of LMMs☆104Updated last month
- [ICLR 2025] What do we expect from LMMs as AIGI evaluators and how do they perform?☆144Updated 3 months ago
- The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"☆174Updated 6 months ago
- Simple PyTorch implementation of "Libra: Building Decoupled Vision System on Large Language Models" (accepted by ICML 2024)☆153Updated 5 months ago
- Official code for TPAMI2024 paper: Pixel Distillation: Cost-flexible Distillation across Image Sizes and Heterogeneous Networks☆58Updated 2 weeks ago
- Official Implementation Code of Our Paper "LightMotion: A Light and Tuning-free Method for Simulating Camera Motion in Video Generation"☆39Updated last month
- A Unified Parameter-Efficient Transfer Learning Benchmark for Computer Vision Tasks☆274Updated 8 months ago
- ☆72Updated last month
- Alchemy Cat —— 🔥Config System for SOTA☆115Updated last month
- Adaptive Draft-Verification for Efficient Large Language Model Decoding (AAAI 2025 Oral)☆65Updated last month