Prototyp MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
☆26Apr 4, 2025Updated 10 months ago
Alternatives and similar repositories for MegaScale-Infer-Prototyp
Users that are interested in MegaScale-Infer-Prototyp are comparing it to the libraries listed below
Sorting:
- Accepted to MLSys 2026☆70Updated this week
- RPCNIC: A High-Performance and Reconfigurable PCIe-attached RPC Accelerator [HPCA2025]☆13Dec 9, 2024Updated last year
- Modular RDMA Interface☆84Updated this week
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆36Aug 29, 2025Updated 6 months ago
- ☆12Oct 18, 2022Updated 3 years ago
- CRAI is a multimodal large language model based on the Mixture of Experts (MoE) architecture, supporting text and image cross-modal tasks…☆16Apr 29, 2025Updated 10 months ago
- Sample Python extension using Rust/PyO3/tch to interact with PyTorch☆41Feb 5, 2024Updated 2 years ago
- R dashboard as a designer☆10Oct 29, 2015Updated 10 years ago
- Protocol buffers and other common resources.☆13Jan 20, 2026Updated last month
- UnrealEngine5版VOICEVOX Engine☆13Nov 29, 2025Updated 3 months ago
- OpenTelemetry layer for HTTP/gRPC services☆10Feb 16, 2026Updated last week
- The code of 《M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image Analysis》☆14Mar 31, 2025Updated 11 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆91Updated this week
- Collection of programming style guides used in Serokell☆12Jul 4, 2022Updated 3 years ago
- HDFS based on Java implementation as a remote ObjectStore for DataFusion☆10Feb 13, 2024Updated 2 years ago
- Version lock, cache, and run binaries from any Github Release assets. Pull in external tools and keep the versions in sync across your te…☆15Jan 3, 2024Updated 2 years ago
- The repo of the Doc2SoarGraph framework☆10Sep 17, 2024Updated last year
- MoE-Visualizer is a tool designed to visualize the selection of experts in Mixture-of-Experts (MoE) models.☆16Apr 8, 2025Updated 10 months ago
- 🎓Automatically Update LLM inference systems Papers Daily using Github Actions (Update Every 12th hours)☆12Updated this week
- [ICML 2025] Efficiently Serving Large Multimodal Models Using EPD Disaggregation☆22May 29, 2025Updated 8 months ago
- ☆14Mar 29, 2024Updated last year
- ☆13Jan 7, 2025Updated last year
- OTP generation & validation library for Rust☆14Dec 4, 2025Updated 2 months ago
- Xenon is a WebDriver proxy, for running multiple WebDriver sessions through a single hub☆12Jun 30, 2022Updated 3 years ago
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated last year
- Memory optimized Mixture of Experts☆73Jul 25, 2025Updated 7 months ago
- High-performance distributed data shuffling (all-to-all) library for MoE training and inference☆112Dec 31, 2025Updated 2 months ago
- ANDROID APP to AUTO GENERATE SUBTITLE FILE and TRANSLATED SUBTITLE FILE (using unofficial online Google Translate API) for any audio/vide…☆20May 5, 2024Updated last year
- AutoML 2024: HPOD: Hyperparameter Optimization for Unsupervised Outlier Detection☆12Jul 12, 2024Updated last year
- A rust wrapper for HIP☆12Jun 10, 2025Updated 8 months ago
- An implementation of FedHealth☆11May 26, 2021Updated 4 years ago
- Utility for running lints specified from files☆12Jul 7, 2022Updated 3 years ago
- GPT-J 6B inference on TensorRT with INT-8 precision☆11Apr 5, 2023Updated 2 years ago
- clustering algorithm implementation☆13Nov 3, 2025Updated 3 months ago
- ☆11Apr 21, 2020Updated 5 years ago
- ☆16Feb 10, 2023Updated 3 years ago
- ☆14Aug 3, 2024Updated last year
- ☆10Apr 29, 2023Updated 2 years ago
- Empowering everyone to create reliable and safety AI coding agent.☆12Sep 2, 2024Updated last year