PKU-DAIR / Hetu-GalvatronLinks
Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs).
☆148Updated 2 weeks ago
Alternatives and similar repositories for Hetu-Galvatron
Users that are interested in Hetu-Galvatron are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆73Updated 2 months ago
- [ICML 2024] JSQ: Compressing Large Language Models by Joint Sparsification and Quantization☆151Updated 7 months ago
- Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs). If you hav…☆20Updated 2 months ago
- Adaptive Draft-Verification for Efficient Large Language Model Decoding (AAAI 2025 Oral)☆66Updated 2 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆222Updated 7 months ago
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆110Updated 3 weeks ago
- ☆144Updated last month
- Official code for ACL2025 "🔍 Retrieval Models Aren’t Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models"☆171Updated last week
- ☆70Updated 2 months ago
- Official Repo for WWW 2025 paper "Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agents"☆210Updated last month
- 大语言模型(LLM)理论+代码教程,由浅入深,带你系统学习LLM的理论知识并从代码层面理解其如何实现。☆26Updated last month
- ☆106Updated 3 years ago
- Official code for "Direct Retrieval-augmented Optimization: Synergizing Knowledge Selection and Language Models"☆176Updated 3 weeks ago
- ☆106Updated last week
- [NeurIPS'24] "Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration"☆182Updated 2 months ago
- Alchemy Cat —— 🔥Config System for SOTA☆115Updated 2 months ago
- ☆340Updated 2 years ago
- Official Repo for AAAI 2024 paper "Confucius: Iterative Tool Learning from Introspection Feedback by Easy-to-Difficult Curriculum"☆78Updated 2 months ago
- Official Repository of paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆145Updated 3 months ago
- Synthora is a lightweight, extensible framework for LLM-driven agents and ALM research. It provides the essential components to build, te…☆71Updated last week
- ARIES (ArXiv Research Intelligent Efficient Summary)☆63Updated 5 months ago
- Official code for paper "Learning to Use Tools via Cooperative and Interactive Agents"☆139Updated last year
- [AAAI'25 Oral] "MIA-Tuner: Adapting Large Language Models as Pre-training Text Detector".☆142Updated 2 months ago
- Pytorch Implementation of "Sinkhorn Distance Minimization for Knowledge Distillation", COLING 2024 and TNNLS 2024☆122Updated last month
- NeoBERT is an advanced model designed specifically for predicting the binding affinity between neoantigens and HLA. It is a variant of th…☆147Updated 5 months ago
- ☆117Updated 11 months ago
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆248Updated 7 months ago
- Official Pytorch Code of the Paper "LightMotion: A Light and Tuning-free Method for Simulating Camera Motion in Video Generation"☆38Updated this week
- Official code for "Iterative Self-Incentivization Empowers Large Language Models as Agentic Searchers"☆70Updated last week
- ☆251Updated 6 months ago