PKU-DAIR / Hetu-GalvatronLinks
Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs).
☆157Updated last month
Alternatives and similar repositories for Hetu-Galvatron
Users that are interested in Hetu-Galvatron are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆74Updated 2 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆227Updated 8 months ago
- [ICML 2024] JSQ: Compressing Large Language Models by Joint Sparsification and Quantization☆150Updated 8 months ago
- Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs). If you hav…☆22Updated 3 months ago
- Official code for ACL2025 "🔍 Retrieval Models Aren’t Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models"☆176Updated 3 weeks ago
- Adaptive Draft-Verification for Efficient Large Language Model Decoding (AAAI 2025 Oral)☆66Updated 2 months ago
- Official Repository of paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆145Updated 3 months ago
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆113Updated last month
- Official Repo for WWW 2025 paper "Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agents"☆199Updated 2 months ago
- ☆173Updated 2 months ago
- ☆106Updated 3 years ago
- ☆102Updated 3 weeks ago
- Official code for paper "Learning to Use Tools via Cooperative and Interactive Agents"☆137Updated last year
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆126Updated last month
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆251Updated 7 months ago
- 🎉 The code repository for "Parrot: Multilingual Visual Instruction Tuning" in PyTorch.☆87Updated 2 weeks ago
- This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…☆154Updated this week
- [NeurIPS'24] "Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration"☆185Updated 3 months ago
- ☆340Updated 2 years ago
- ☆117Updated last year
- MM-IFEngine: Towards Multimodal Instruction Following☆92Updated 2 months ago
- ☆103Updated 7 months ago
- Alchemy Cat —— 🔥Config System for SOTA☆115Updated 3 months ago
- ☆202Updated 7 months ago
- ARIES (ArXiv Research Intelligent Efficient Summary)☆62Updated 5 months ago
- NeoBERT is an advanced model designed specifically for predicting the binding affinity between neoantigens and HLA. It is a variant of th…☆147Updated 6 months ago
- code and document for MIT6.5840(6.824) 2024 Spring☆68Updated 3 months ago
- Reasoning-Table: Exploring Reinforcement Learning for Table Reasoning☆73Updated 3 weeks ago
- [AAAI'25 Oral] "MIA-Tuner: Adapting Large Language Models as Pre-training Text Detector".☆142Updated 3 months ago
- Synthora is a lightweight, extensible framework for LLM-driven agents and ALM research. It provides the essential components to build, te…☆71Updated 3 weeks ago