☆15Jun 26, 2024Updated 2 years ago
Alternatives and similar repositories for MuxServe
Users that are interested in MuxServe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆56Sep 23, 2026Updated last month
- ☆10Sep 12, 2024Updated 2 years ago
- ☆19Sep 21, 2025Updated last year
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)☆94Jul 14, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆10Apr 5, 2025Updated last year
- ☆17Jun 14, 2026Updated 4 months ago
- This repo contains LaTeX template for experiment report.☆11Aug 17, 2021Updated 5 years ago
- ☆18Sep 27, 2026Updated last month
- ☆38Nov 28, 2024Updated last year
- ☆12Jan 12, 2024Updated 2 years ago
- This is the public repo for DREAM accepted to ICS 2025.☆12Dec 28, 2025Updated 10 months ago
- ☆21May 11, 2026Updated 5 months ago
- Rebuild YatSenOS On RISC-V 64.☆23Jan 6, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems☆292Jun 30, 2026Updated 4 months ago
- GPU TopK Benchmark☆18Dec 19, 2024Updated last year
- Lithops application examples☆11Dec 19, 2024Updated last year
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆186Jul 12, 2024Updated 2 years ago
- [OSDI' 26] Efficient LLM Serving on Commodity GPU Clusters with Data-Reduced Cross-Instance Orchestration☆29Jul 5, 2026Updated 3 months ago
- A curated list for Efficient Large Language Models☆11Mar 25, 2024Updated 2 years ago
- ☆10May 12, 2022Updated 4 years ago
- ☆92Oct 17, 2025Updated last year
- Service-aware KV-cache compression for bandwidth-efficient disaggregated LLM serving.☆31Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- play gemm with tvm☆91Jul 22, 2023Updated 3 years ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆34Nov 29, 2024Updated last year
- Code for the "Cherry: A Distributed Task-Aware Shuffle Service for Serverless Analytics" paper for 2021 IEEE International Conference on …☆16Feb 3, 2022Updated 4 years ago
- Intel AMX matrix multiplication experiments☆13Jan 24, 2024Updated 2 years ago
- ☆15Apr 11, 2024Updated 2 years ago
- This is the code repository for our work on resourcing-on-demand GPU provisioning for serverless deep learning serving.☆17Apr 17, 2026Updated 6 months ago
- DLL注入工具☆13Nov 9, 2020Updated 5 years ago
- ☆27Aug 19, 2022Updated 4 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Jun 21, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆137Nov 11, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆10Jul 22, 2023Updated 3 years ago
- QAQ: Quality Adaptive Quantization for LLM KV Cache☆55Mar 27, 2024Updated 2 years ago
- OpenGL 学习代码☆15Jun 25, 2023Updated 3 years ago
- ☆13Mar 28, 2025Updated last year
- ☆14Nov 7, 2024Updated last year
- OptiWISE profiling tool for granular CPI analysis.☆12Mar 18, 2025Updated last year