PKU-DAIR / Hetu-Galvatron
Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs).
☆145Updated this week
Alternatives and similar repositories for Hetu-Galvatron:
Users that are interested in Hetu-Galvatron are comparing it to the libraries listed below
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆70Updated 3 weeks ago
- [ICML 2024] JSQ: Compressing Large Language Models by Joint Sparsification and Quantization☆149Updated 6 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆209Updated 6 months ago
- Official code for "🔍 Retrieval Models Aren’t Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models"☆165Updated 3 weeks ago
- ☆72Updated last month
- Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs). If you hav…☆20Updated last month
- ☆78Updated last week
- Official Repo for WWW 2025 paper "Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agents"☆198Updated 2 weeks ago
- Adaptive Draft-Verification for Efficient Large Language Model Decoding (AAAI 2025 Oral)☆65Updated 3 weeks ago
- ☆106Updated 3 years ago
- Official Repository of paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆146Updated last month
- ☆106Updated 8 months ago
- Official code for paper "Learning to Use Tools via Cooperative and Interactive Agents"☆137Updated last year
- ☆339Updated last year
- Official code for "Direct Retrieval-augmented Optimization: Synergizing Knowledge Selection and Language Models"☆72Updated 2 weeks ago
- ARIES (ArXiv Research Intelligent Efficient Summary)☆64Updated 3 months ago
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆105Updated 2 months ago
- Official Repo for AAAI 2024 paper "Confucius: Iterative Tool Learning from Introspection Feedback by Easy-to-Difficult Curriculum"☆79Updated last month
- 🤖 Discord AI assistant with OpenAI, Gemini, Claude & DeepSeek integration, multilingual support, multimodal chat, image generation, web …☆156Updated last month
- [NeurIPS'24] "Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration"☆182Updated last month
- ☆117Updated 10 months ago
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆237Updated 5 months ago
- golang的支持调用所有openai范式的ai的api的库☆131Updated 2 weeks ago
- ☆244Updated 5 months ago
- Official Implementation Code of Our Paper "LightMotion: A Light and Tuning-free Method for Simulating Camera Motion in Video Generation"☆38Updated 2 weeks ago
- a theme for typora☆56Updated last month
- ☆14Updated 2 weeks ago
- Turning every screen moment into a memory at your fingertips.☆183Updated 3 months ago
- ai_developer is an AI-driven software engineer that turns a single-line requirement into a fully functional project.☆69Updated 2 months ago
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆117Updated 3 weeks ago