[OSDI' 26] Efficient LLM Serving on Commodity GPU Clusters with Data-Reduced Cross-Instance Orchestration
☆24Jul 5, 2026Updated last month
Alternatives and similar repositories for EcoServe
Users that are interested in EcoServe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICPP'25] TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference☆52Dec 24, 2025Updated 8 months ago
- A Rust x86_64 OS lab tutorial.☆72Jun 23, 2026Updated 2 months ago
- byocc.cc☆26Aug 13, 2026Updated last week
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- Spack package repository maintained by Student Cluster Competition Team @ Sun Yat-sen University.☆16Aug 20, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Efficient Auto-scalable Scientific Infrastructure for Engineers and Researchers☆16Jul 10, 2026Updated last month
- Rebuild YatSenOS On RISC-V 64.☆23Jan 6, 2022Updated 4 years ago
- Acceleration codes for the Ozaki-scheme on integer matrix multiplication units.☆27Dec 10, 2025Updated 8 months ago
- ☆20Jun 25, 2025Updated last year
- An Efficient RDMA-based RPC Framework☆25Nov 14, 2023Updated 2 years ago
- A terminal based monitoring tool for InfiniBand networks using Detector (https://github.com/hhu-bsinfo/detector)☆15Aug 7, 2019Updated 7 years ago
- ☆13Jun 29, 2024Updated 2 years ago
- [ICLR 2026🔥] MHLA: Restoring Expressivity of Linear Attention via Token-Level Multi-Head☆154May 19, 2026Updated 3 months ago
- Nexa - The FIRST-EVER Harness Native Agent Language☆34Jul 10, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Documentation for YatCPU☆55Nov 15, 2023Updated 2 years ago
- 这是一个 后端使用django框架、前端使用vue 的学生在线答题平台，实现的功能包括 使用邮箱通过发送验证码进行登录/注册 登录后的用户可以进行答题（单选题） 用户可以查看自己的答题记录，对错题本进行管理（添加/移除题目） 用户可以查看每道题的答题情况(答题人数、正确率…☆15Oct 1, 2023Updated 2 years ago
- A distributed key value database based on LSM Tree storage☆15Aug 24, 2022Updated 4 years ago
- 中山大学编译原理课程实验（完全重构版本）☆148Jun 19, 2026Updated 2 months ago
- PTX-EMU is a simple emulator for CUDA program.☆40Apr 25, 2025Updated last year
- 中山大学计算机学院Matrix系统 2022数据结构课程 的练习和答案☆14Mar 4, 2023Updated 3 years ago
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆52Jan 8, 2026Updated 7 months ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆34Nov 29, 2024Updated last year
- ☆13Apr 27, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A user-space GPU Direct Storage library☆194Updated this week
- Yat another MySQL storage engine, a database course project.☆13Dec 23, 2022Updated 3 years ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated last year
- Our Clone of Orca used for experimentation☆20Oct 15, 2024Updated last year
- 《自适应的快速人脸肤色转移》(Adaptive Fast Face Color Transfer)论文复现☆26Jul 25, 2017Updated 9 years ago
- Agent-native Seedance 2.0 short-film studio: cli for AI, canvas for human☆16Jun 14, 2026Updated 2 months ago
- Yet another toy CPU.☆92Dec 10, 2023Updated 2 years ago
- ☆16Nov 2, 2022Updated 3 years ago
- play gemm with tvm☆91Jul 22, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆15Jun 26, 2024Updated 2 years ago
- Lightning In-Memory Object Store☆47Jan 22, 2022Updated 4 years ago
- ☆66May 7, 2026Updated 3 months ago
- A code sample demonstrating how to share and rebuild a PyTorch GPU tensor via its pointer/reference between different processes.☆15Aug 27, 2024Updated last year
- This repo contains LaTeX template for experiment report.☆11Aug 17, 2021Updated 5 years ago
- An asynchronous streaming data management module for efficient post-training.☆135Updated this week
- Collect information about 2018 CS courses in CSE of SYSU.☆11Jun 29, 2022Updated 4 years ago