[OSDI' 26] Efficient LLM Serving on Commodity GPU Clusters with Data-Reduced Cross-Instance Orchestration
☆27Jul 5, 2026Updated 3 months ago
Alternatives and similar repositories for EcoServe
Users that are interested in EcoServe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICPP'25] TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference☆52Dec 24, 2025Updated 9 months ago
- GoPTX: Fine-grained GPU Kernel Fusion by PTX-level Instruction Flow Weaving☆21Jul 30, 2025Updated last year
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- ☆10May 12, 2022Updated 4 years ago
- byocc.cc☆27Sep 30, 2026Updated 3 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A Rust x86_64 OS lab tutorial.☆72Jun 23, 2026Updated 4 months ago
- ☆13Jun 29, 2024Updated 2 years ago
- 大学生最实用的工具之——上课摸鱼助手，再也不用怕临时点名回答问题时没听课了！☆89Oct 16, 2026Updated last week
- Spack package repository maintained by Student Cluster Competition Team @ Sun Yat-sen University.☆16Aug 20, 2025Updated last year
- Efficient Auto-scalable Scientific Infrastructure for Engineers and Researchers☆16Jul 10, 2026Updated 3 months ago
- ☆20Sep 17, 2026Updated last month
- An Efficient RDMA-based RPC Framework☆25Nov 14, 2023Updated 2 years ago
- Rebuild YatSenOS On RISC-V 64.☆23Jan 6, 2022Updated 4 years ago
- A terminal based monitoring tool for InfiniBand networks using Detector (https://github.com/hhu-bsinfo/detector)☆15Aug 7, 2019Updated 7 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆54Sep 23, 2026Updated last month
- A living guide of the systems that train, serve, and scale LLMs☆42Sep 1, 2026Updated last month
- [ICLR 2026🔥] MHLA: Restoring Expressivity of Linear Attention via Token-Level Multi-Head☆157May 19, 2026Updated 5 months ago
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆38Jul 12, 2026Updated 3 months ago
- ☆15Jun 26, 2024Updated 2 years ago
- Documentation for YatCPU☆55Nov 15, 2023Updated 2 years ago
- A linker for partial GPU kernels.☆32Oct 12, 2026Updated last week
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆18Aug 6, 2026Updated 2 months ago
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression（EMNLP 2025）☆12Jan 15, 2025Updated last year
- 中山大学计算机学院Matrix系统 2022数据结构课程 的练习和答案☆14Mar 4, 2023Updated 3 years ago
- PTX-EMU is a simple emulator for CUDA program.☆40Apr 25, 2025Updated last year
- Yat another MySQL storage engine, a database course project.☆13Dec 23, 2022Updated 3 years ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆34Nov 29, 2024Updated last year
- A user-space GPU Direct Storage library☆217Updated this week
- ☆37Mar 7, 2025Updated last year
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated last year
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Our Clone of Orca used for experimentation☆21Oct 15, 2024Updated 2 years ago
- 上海交通大学Xflops超算队2024招新第一轮考核试题☆16Oct 15, 2024Updated 2 years ago
- Agent-native Seedance 2.0 short-film studio: cli for AI, canvas for human☆17Sep 8, 2026Updated last month
- Yet another toy CPU.☆93Dec 10, 2023Updated 2 years ago
- A schedule language for large model training☆153Aug 21, 2025Updated last year
- ☆16Nov 2, 2022Updated 3 years ago
- Rethinking World-Action Model for Compositional and In-context Robotic Manipulation☆102Oct 15, 2026Updated last week