[OSDI' 26] Efficient LLM Serving on Commodity GPU Clusters with Data-Reduced Cross-Instance Orchestration
☆30Jul 5, 2026Updated 4 months ago
Alternatives and similar repositories for EcoServe
Users that are interested in EcoServe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICPP'25] TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference☆53Dec 24, 2025Updated 10 months ago
- ☆14Jun 29, 2024Updated 2 years ago
- GoPTX: Fine-grained GPU Kernel Fusion by PTX-level Instruction Flow Weaving☆21Jul 30, 2025Updated last year
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- ☆10May 12, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Spack package repository maintained by Student Cluster Competition Team @ Sun Yat-sen University.☆16Aug 20, 2025Updated last year
- An Efficient RDMA-based RPC Framework☆25Nov 14, 2023Updated 2 years ago
- ☆22Sep 17, 2026Updated last month
- Acceleration codes for the Ozaki-scheme on integer matrix multiplication units.☆28Dec 10, 2025Updated 11 months ago
- Rebuild YatSenOS On RISC-V 64.☆23Jan 6, 2022Updated 4 years ago
- 一款高自由度的，用于显示教学信息的壁纸软件，功能包括高考倒计时、公告栏、以及能够提示当前课程的课程表。☆24Sep 13, 2025Updated last year
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆56Sep 23, 2026Updated last month
- ☆15Jun 26, 2024Updated 2 years ago
- An efficient service for transparent GPU multiplexing with VRAM oversubscription, OSDI '26☆14Sep 24, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Documentation for YatCPU☆55Nov 15, 2023Updated 2 years ago
- [ICLR 2026🔥] MHLA: Restoring Expressivity of Linear Attention via Token-Level Multi-Head☆160May 19, 2026Updated 5 months ago
- ☆18Jul 19, 2026Updated 3 months ago
- A distributed key value database based on LSM Tree storage☆15Aug 24, 2022Updated 4 years ago
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆30Oct 8, 2026Updated last month
- A user-space GPU Direct Storage library☆244Oct 23, 2026Updated 2 weeks ago
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆18Aug 6, 2026Updated 3 months ago
- 简简单单的手搓神经网络框架☆13May 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆34Nov 29, 2024Updated last year
- ☆11May 4, 2022Updated 4 years ago
- PTX-EMU is a simple emulator for CUDA program.☆41Apr 25, 2025Updated last year
- ☆37Mar 7, 2025Updated last year
- 中山大学计算机学院Matrix系统 2022数据结构课程 的练习和答案☆14Mar 4, 2023Updated 3 years ago
- More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression（EMNLP 2025）☆12Jan 15, 2025Updated last year
- ☆13Apr 27, 2022Updated 4 years ago
- 2023 XFlops Training☆13Jan 23, 2024Updated 2 years ago
- ☆14Aug 27, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- HUST-SSE Software-Engineering-Curriculum-Design: Translation Miniprogram | 华中科技大学软件学院软件工程课设：机器翻译小程序☆24Aug 16, 2023Updated 3 years ago
- Generator Bootcamp Material: Learn Chisel the Right Way☆16Jun 23, 2024Updated 2 years ago
- Foundry materializes CUDA graphs along with its execution context to disk to support fast cold start of serving engines.☆71Updated this week
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated last year
- Yat another MySQL storage engine, a database course project.☆13Dec 23, 2022Updated 3 years ago
- Low-level command-line tool for measuring CPU and Metal GPU memory bandwidth, synthetic LLM decode and prefill memory traffic, cache and …☆22Sep 25, 2026Updated last month
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
Are these results useful?