Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"
☆23Apr 13, 2024Updated 2 years ago
Alternatives and similar repositories for SiDA-MoE
Users that are interested in SiDA-MoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".☆19Oct 30, 2024Updated 2 years ago
- Explore Inter-layer Expert Affinity in MoE Model Inference☆17May 6, 2024Updated 2 years ago
- [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration☆268Nov 18, 2024Updated 2 years ago
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆384Updated this week
- ☆27May 31, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Paper-reading notes for Berkeley OS prelim exam.☆14Aug 28, 2024Updated 2 years ago
- Nano vLLM☆11Feb 26, 2026Updated 8 months ago
- ☆13Oct 6, 2024Updated 2 years ago
- Preview Code for MARS Paper☆12Nov 3, 2026Updated 2 weeks ago
- Curated collection of papers in MoE model inference☆434Mar 12, 2026Updated 8 months ago
- KDSS is the framework for knowledge distillation from LLMs☆12Nov 5, 2025Updated last year
- ☆12Sep 24, 2025Updated last year
- ☆46Nov 15, 2022Updated 4 years ago
- transformer layers behavior as painters🧑🎨☆15May 6, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This repository contains MATLAB codes for CP tensor decompositions that use the more stable QR decomposition for problems with ill-condit…☆14Dec 16, 2021Updated 4 years ago
- Artifact for paper: ZipMoE☆18May 28, 2026Updated 5 months ago
- Battleship environment for reinforcement learning tasks☆15Apr 29, 2023Updated 3 years ago
- Incremental Mobile User Profiling: Reinforcement Learning with Spatial Knowledge Graph for Modeling Event Streams☆15Jul 25, 2024Updated 2 years ago
- ☆26Nov 11, 2026Updated last week
- ☆14Jun 29, 2024Updated 2 years ago
- ☆20Sep 26, 2026Updated last month
- High-Throughput Batch Inference☆22Updated this week
- [AAAI 2026] Official implementation of "FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models". If you find this reposi…☆19Aug 26, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Feb 24, 2026Updated 8 months ago
- Scaling Up Memory Disaggregated Applications with SMART (ASPLOS 24): Predecessor of Mooncake TE☆34Jul 23, 2026Updated 3 months ago
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 7 months ago
- This artifact accompanies the paper 'Pronghorn: Effective Checkpoint Orchestration for Serverless Hot-Starts,' which has been accepted fo…☆22Nov 8, 2023Updated 3 years ago
- Send timed message to Wechat. (向微信推送定时消息)☆25Jan 22, 2025Updated last year
- ☆51Dec 26, 2024Updated last year
- ☆21Jan 27, 2025Updated last year
- Communication-Efficient Diffusion Denoising Parallelization via Reuse-then-Predict Mechanism (NIPS'25)☆18Oct 6, 2025Updated last year
- Efficient and easy multi-instance LLM serving☆561Mar 12, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is the repository for USTC-MSRA 2023 Innovation Project, with the topic of Dynamic Simulation.☆10Aug 30, 2023Updated 3 years ago
- Python scripts from Shape of Data Case Studies☆14Jan 7, 2014Updated 12 years ago
- 2022 USTC 011705 (OSH) Course Project of Runikraft Group☆13Jul 22, 2022Updated 4 years ago
- All-in-one benchmarking platform for evaluating LLM.☆16Nov 12, 2025Updated last year
- ☆13Dec 9, 2024Updated last year
- Official implementation of "Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent".☆23May 23, 2025Updated last year
- Artifact evaluation repo for EuroSys'24.☆30Nov 7, 2023Updated 3 years ago
Are these results useful?