Explore Inter-layer Expert Affinity in MoE Model Inference
☆17May 6, 2024Updated 2 years ago
Alternatives and similar repositories for ExFlow
Users that are interested in ExFlow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Feb 7, 2025Updated last year
- Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".☆19Oct 30, 2024Updated 2 years ago
- FlowPrefill: Decoupling Preemption from Prefill Scheduling Granularity to Mitigate Head-of-Line Blocking in LLM Serving☆12Aug 3, 2026Updated 3 months ago
- [NeurIPS2024] "Read-ME: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design", Ruisi Cai, Yeonju Ro, Geon-Woo …☆17Dec 16, 2024Updated last year
- ☆92Apr 2, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆14Jun 29, 2024Updated 2 years ago
- Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"☆23Apr 13, 2024Updated 2 years ago
- ☆16Jan 14, 2025Updated last year
- ATC23 AE☆45May 11, 2023Updated 3 years ago
- ☆64May 4, 2024Updated 2 years ago
- ☆29May 24, 2024Updated 2 years ago
- based on Differential Cryptanalysis of the Full 16-round DES(Eli Biham / Adi Shamir), all comments and report are written in Korean.☆10Dec 19, 2022Updated 3 years ago
- KDSS is the framework for knowledge distillation from LLMs☆12Nov 5, 2025Updated last year
- LM/VLM implementations☆12Oct 13, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official code for the paper "HEXA-MoE: Efficient and Heterogeneous-Aware MoE Acceleration with Zero Computation Redundancy"☆16Mar 6, 2025Updated last year
- 一些雅思学习工具,包括单词、听力、阅读、写作、考场分析☆14Aug 30, 2025Updated last year
- Inline PTX Assembly in CUDA example☆15Oct 5, 2026Updated last month
- Incremental Mobile User Profiling: Reinforcement Learning with Spatial Knowledge Graph for Modeling Event Streams☆15Jul 25, 2024Updated 2 years ago
- [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration☆268Nov 18, 2024Updated 2 years ago
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Aug 25, 2026Updated 2 months ago
- LLM serving simulator that uses DoolyProf's latency database; built around the vLLM's native scheduler.☆15Oct 28, 2026Updated 3 weeks ago
- Code for MPhil Thesis at University of Cambridge☆13Jun 10, 2024Updated 2 years ago
- Reasoning-Reinforced Representation for Search☆15Oct 9, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆23Feb 10, 2025Updated last year
- FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]☆53Aug 2, 2026Updated 3 months ago
- ☆17Nov 11, 2026Updated last week
- MISO: Exploiting Multi-Instance GPU Capability on Multi-Tenant GPU Clusters☆21Apr 21, 2023Updated 3 years ago
- ☆12Dec 17, 2022Updated 3 years ago
- EFOK-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operation☆11Mar 11, 2024Updated 2 years ago
- ☆14Dec 22, 2024Updated last year
- CUDA MoE kernels.☆13Sep 21, 2024Updated 2 years ago
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆385Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆15Apr 11, 2024Updated 2 years ago
- ☆10Dec 17, 2020Updated 5 years ago
- ASIC simulation of Multi-ported Memory Module. And it can offer SRAM-based dual-port basic building block to support multiple read/write …☆25May 30, 2016Updated 10 years ago
- Intrinsic Curiosity Module (ICM) + PPO on the Pyramid and PushBlock environment.☆12Sep 3, 2019Updated 7 years ago
- Serve large files on Cloudflare Pages directly from Git LFS☆16Sep 1, 2023Updated 3 years ago
- Compiler for Dynamic Neural Networks☆45Nov 13, 2023Updated 3 years ago
- An experimentation platform for LLM inference optimisation☆36Sep 19, 2024Updated 2 years ago
Are these results useful?