PKU-DAIR / Hetu-GalvatronLinks
Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs).
☆167Updated last week
Alternatives and similar repositories for Hetu-Galvatron
Users that are interested in Hetu-Galvatron are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆72Updated 6 months ago
- Flash Dynamic Mask Attention☆309Updated this week
- [ICML 2024] JSQ: Compressing Large Language Models by Joint Sparsification and Quantization☆144Updated 11 months ago
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆242Updated 11 months ago
- Official code for ACL2025 "🔍 Retrieval Models Aren’t Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models"☆196Updated 3 months ago
- Adaptive Draft-Verification for Efficient Large Language Model Decoding (AAAI 2025 Oral)☆68Updated 6 months ago
- Official Repo for WWW 2025 paper "Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agents"☆190Updated 6 months ago
- ☆112Updated 4 months ago
- Official repo for 'Large Multimodal Models Evaluation: A Survey'☆82Updated this week
- Reasoning-Table: Exploring Reinforcement Learning for Table Reasoning☆124Updated 4 months ago
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆112Updated 4 months ago
- NeoBERT is an advanced model designed specifically for predicting the binding affinity between neoantigens and HLA. It is a variant of th…☆154Updated 9 months ago
- ☆173Updated 5 months ago
- Official code for paper "Learning to Use Tools via Cooperative and Interactive Agents"☆222Updated last year
- Alchemy Cat —— 🔥Config System for SOTA☆110Updated 2 months ago
- [NeurIPS'24] "Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration"☆193Updated 6 months ago
- ☆195Updated 10 months ago
- ARIES (ArXiv Research Intelligent Efficient Summary)☆71Updated 9 months ago
- ai_developer is an AI-driven software engineer that turns a single-line requirement into a fully functional project.☆59Updated 7 months ago
- EasyDeploy is engineered to provide users with end-to-end deployment capabilities for large-scale models.☆134Updated 5 months ago
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆276Updated 11 months ago
- code and document for MIT6.5840(6.824) 2024 Spring☆64Updated 6 months ago
- ☆338Updated 2 years ago
- Logic for application☆33Updated last year
- a Simple and elegant theme for gridea (inspire from hexo-theme-matery).☆61Updated 7 months ago
- Navigating Model Phase Transitions to Enable Extreme Lossless Compression: A Perspective☆74Updated 2 months ago
- [AAAI'25 Oral] "MIA-Tuner: Adapting Large Language Models as Pre-training Text Detector".☆147Updated 6 months ago
- golang的支持调用所有openai范式的ai的api的库☆122Updated 3 months ago
- Official Repo for AAAI 2024 paper "Confucius: Iterative Tool Learning from Introspection Feedback by Easy-to-Difficult Curriculum"☆137Updated 7 months ago
- 一款基于 Typecho 默认主题 Replica 开发的博客主题,旨在简约现代的基础上提升阅读体验。☆113Updated 3 months ago