Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"
☆23Apr 13, 2024Updated 2 years ago
Alternatives and similar repositories for SiDA-MoE
Users that are interested in SiDA-MoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".☆19Oct 30, 2024Updated 2 years ago
- [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration☆267Nov 18, 2024Updated last year
- Explore Inter-layer Expert Affinity in MoE Model Inference☆17May 6, 2024Updated 2 years ago
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆376Updated this week
- ☆13Oct 6, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Paper-reading notes for Berkeley OS prelim exam.☆14Aug 28, 2024Updated 2 years ago
- Curated collection of papers in MoE model inference☆430Mar 12, 2026Updated 7 months ago
- ☆12Sep 24, 2025Updated last year
- ☆25Mar 3, 2026Updated 7 months ago
- KDSS is the framework for knowledge distillation from LLMs☆12Nov 5, 2025Updated 11 months ago
- ☆45Nov 15, 2022Updated 3 years ago
- Official implementation of CrossPipe: Towards Optimal Pipeline Schedules for Cross-Datacenter Training (ATC '25), built on top of Megatro…☆17Jul 6, 2025Updated last year
- transformer layers behavior as painters🧑🎨☆15May 6, 2025Updated last year
- ☆14Oct 26, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Battleship environment for reinforcement learning tasks☆15Apr 29, 2023Updated 3 years ago
- ☆13Jun 29, 2024Updated 2 years ago
- High-Throughput Batch Inference☆18Updated this week
- ☆19Sep 26, 2026Updated last month
- [AAAI 2026] Official implementation of "FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models". If you find this reposi…☆19Aug 26, 2026Updated 2 months ago
- [ICML 2026] Official implementation of "FOCUS: DLLMs Know How to Tame Their Compute Bound".☆19Aug 2, 2026Updated 3 months ago
- ☆18Feb 24, 2026Updated 8 months ago
- Scaling Up Memory Disaggregated Applications with SMART (ASPLOS 24): Predecessor of Mooncake TE☆34Jul 23, 2026Updated 3 months ago
- Communication-Efficient Diffusion Denoising Parallelization via Reuse-then-Predict Mechanism (NIPS'25)☆17Oct 6, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This artifact accompanies the paper 'Pronghorn: Effective Checkpoint Orchestration for Serverless Hot-Starts,' which has been accepted fo…☆22Nov 8, 2023Updated 2 years ago
- ☆34Jun 22, 2024Updated 2 years ago
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- ☆20Jan 27, 2025Updated last year
- ☆51Dec 26, 2024Updated last year
- ☆13Dec 9, 2024Updated last year
- Efficient and easy multi-instance LLM serving☆561Mar 12, 2026Updated 7 months ago
- Python scripts from Shape of Data Case Studies☆14Jan 7, 2014Updated 12 years ago
- Artifact evaluation repo for EuroSys'24.☆30Nov 7, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 2022 USTC 011705 (OSH) Course Project of Runikraft Group☆13Jul 22, 2022Updated 4 years ago
- All-in-one benchmarking platform for evaluating LLM.☆16Nov 12, 2025Updated 11 months ago
- Official implementation of "Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent".☆23May 23, 2025Updated last year
- Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"☆32Mar 28, 2024Updated 2 years ago
- Official implementation for the paper Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapp…☆15May 20, 2026Updated 5 months ago
- A high-performance CLI tool written in Rust that acts as a standalone Git Agent.☆11Apr 15, 2026Updated 6 months ago
- Synthesized data from real-world traces of data-intensive applications for coflow benchmarking.☆28Aug 5, 2015Updated 11 years ago