Engine-Agnostic Model Hot-Swapping for Cost-Effective LLM Inference
☆15Nov 13, 2025Updated 11 months ago
Alternatives and similar repositories for SwapServeLLM
Users that are interested in SwapServeLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the code repository for our work on resourcing-on-demand GPU provisioning for serverless deep learning serving.☆17Apr 17, 2026Updated 6 months ago
- code repo for GCR [FAST'26]☆18Mar 3, 2026Updated 8 months ago
- ☆21May 11, 2026Updated 6 months ago
- Simplifying FPGA management in Docker☆13Mar 20, 2024Updated 2 years ago
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆50May 13, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12May 30, 2023Updated 3 years ago
- Foundry materializes CUDA graphs along with its execution context to disk to support fast cold start of serving engines.☆71Updated this week
- Node-level enforcement and metrics for fractional GPU allocations made by KAI Scheduler.☆59Updated this week
- OCEAN – Open-source CXL Emulation at Hyperscale Architecture and Networking☆14Feb 9, 2026Updated 9 months ago
- ☆10Sep 25, 2024Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆13Jul 14, 2025Updated last year
- Simple example for learning and serving 'MNIST' in kubernetes cluster☆10Mar 27, 2019Updated 7 years ago
- FlowPrefill: Decoupling Preemption from Prefill Scheduling Granularity to Mitigate Head-of-Line Blocking in LLM Serving☆12Aug 3, 2026Updated 3 months ago
- Cylon FAST '26 AE☆17Oct 10, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Example for Samsung smart ssd☆10Nov 24, 2020Updated 5 years ago
- ☆13Sep 4, 2026Updated 2 months ago
- A fault-tolerant RDMA-based disaggregated key-value store with 1-RTT UPDATEs and GETs thanks to the SWARM replication protocol☆14Sep 25, 2024Updated 2 years ago
- Source Code for Partial Interference☆10Dec 17, 2022Updated 3 years ago
- ☆13Apr 7, 2025Updated last year
- Unit tests for the kernel virtual machine (KVM)☆14Jan 20, 2021Updated 5 years ago
- R interface to CUDA libraries☆22Jul 27, 2016Updated 10 years ago
- Proximal Policy Optimization(PPO) with Keras Implementation☆17Aug 8, 2020Updated 6 years ago
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆56Sep 23, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- "JABAS: Joint Adaptive Batching and Automatic Scaling for DNN Training on Heterogeneous GPUs" (EuroSys '25)☆16Apr 7, 2025Updated last year
- A new memory mapping interface for efficient direct user-space access to byte-addressable storage, published in MICRO2022.☆15Sep 29, 2022Updated 4 years ago
- ☆12Mar 22, 2022Updated 4 years ago
- A dataset to shed light upon Serverless computing.☆14Mar 19, 2021Updated 5 years ago
- ☆23Feb 26, 2026Updated 8 months ago
- A minimal bootstrap scheme for fast boot of serverless microVMs with AMD Secure Encrypted Virtualization (SEV)☆15Feb 7, 2024Updated 2 years ago
- Meta repository for the USENIX ATC'25 Publication "Accelerating Nested Virtualization with HyperTurtle"☆19Mar 22, 2026Updated 7 months ago
- ☆16May 23, 2023Updated 3 years ago
- ☆15Mar 10, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- OrcBench: A Representative Serverless Benchmark☆14Nov 23, 2022Updated 3 years ago
- ☆27Oct 6, 2025Updated last year
- Repository linking to the software artifacts used for the MigrOS ATC 2021 paper☆18May 31, 2021Updated 5 years ago
- Open-source repository for the paper "DyTIS: A Dynamic Dataset Targeted Index Structure Simultaneously Efficient for Search, Insert, and …☆14May 16, 2023Updated 3 years ago
- ☆20Feb 14, 2018Updated 8 years ago
- ☆15Dec 13, 2024Updated last year
- dra-driver for HAMi☆29Nov 6, 2026Updated last week
Are these results useful?