Accommodating Large Language Model Training over Heterogeneous Environment.
☆36Mar 13, 2025Updated last year
Alternatives and similar repositories for HexiScale
Users that are interested in HexiScale are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆37May 6, 2024Updated 2 years ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆45Nov 4, 2022Updated 4 years ago
- Dynamic resources changes for multi-dimensional parallelism training☆31Aug 22, 2025Updated last year
- Simulation code for MixNet (SIGCOMM'25)☆15Nov 3, 2025Updated last year
- ☆93Jul 3, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆38Updated this week
- ☆25May 10, 2023Updated 3 years ago
- ☆10Jul 23, 2024Updated 2 years ago
- ACPO: Python ML training/inference framework for LLVM optimizations☆15Jul 2, 2025Updated last year
- This repository is established to store personal notes and annotated papers during daily research.☆200Jun 28, 2026Updated 4 months ago
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆73Mar 20, 2025Updated last year
- ☆19May 4, 2023Updated 3 years ago
- A Triton-only attention backend for vLLM☆28Jul 14, 2026Updated 4 months ago
- analyse problems of AI with Math and Code☆31Jul 28, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆18Jul 19, 2026Updated 4 months ago
- ☆17Jul 12, 2025Updated last year
- A variant of Ahash written in C++.☆10Mar 20, 2023Updated 3 years ago
- ML performance model for GPU training of DLRM and more.☆12Apr 22, 2025Updated last year
- Collection of recent methods on 3D Scene Generation from Text Description.☆17Mar 3, 2025Updated last year
- A high-performance distributed deep learning system targeting large-scale and automated distributed training.☆344Dec 13, 2025Updated 11 months ago
- ☆10Nov 9, 2023Updated 3 years ago
- ☆32Mar 24, 2025Updated last year
- [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…☆52May 31, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading☆101Jun 16, 2025Updated last year
- This repository contains multiple implementations of Flash Attention optimized with Triton kernels, showcasing progressive performance im…☆13Mar 26, 2026Updated 7 months ago
- ☆13Mar 27, 2024Updated 2 years ago
- Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)☆67Nov 11, 2026Updated last week
- Official implementation of CrossPipe: Towards Optimal Pipeline Schedules for Cross-Datacenter Training (ATC '25), built on top of Megatro…☆17Jul 6, 2025Updated last year
- A PyTorch implementation of Knowledge Graph Embedding by Normalizing Flows.☆10Nov 22, 2022Updated 3 years ago
- 2023年全国大学生计算机系统能力大赛数据库管理系统设计赛全国一等奖作品☆10Oct 6, 2023Updated 3 years ago
- implementation of TDConvED for video captioning☆13Mar 18, 2020Updated 6 years ago
- Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.☆29Apr 25, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ASPLOS'24] FaaSMem: Improving Memory Efficiency of Serverless Computing with Memory Pool Architecture☆13Nov 4, 2024Updated 2 years ago
- Code for KVDirect: Distributed Disaggregated LLM Inference☆10Apr 28, 2025Updated last year
- standalone react MCP client using SSE☆13Mar 10, 2025Updated last year
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- A new signing tool using provenance based identity.☆12Oct 29, 2026Updated 2 weeks ago
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆48Jul 12, 2024Updated 2 years ago
- ☆13Apr 7, 2025Updated last year
Are these results useful?