☆36May 26, 2026Updated last month
Alternatives and similar repositories for llumnix
Users that are interested in llumnix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆33Jun 15, 2026Updated last month
- ☆31Updated this week
- Efficient and easy multi-instance LLM serving☆562Mar 12, 2026Updated 4 months ago
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆64Jun 5, 2024Updated 2 years ago
- Prototype implementation and extended paper of SDPaxos☆16Nov 30, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code for paper "Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI"☆13Jan 19, 2024Updated 2 years ago
- Verifiable Forward Secure SSE scheme☆10Mar 9, 2020Updated 6 years ago
- DeepRec Extension is an easy-to-use, stable and efficient large-scale distributed training system based on DeepRec.☆13May 17, 2024Updated 2 years ago
- ElasticMM: Elastic and Efficient MLLM Serving System☆44May 10, 2026Updated 2 months ago
- ☆37Jul 14, 2023Updated 3 years ago
- LOUDS-trie implementation example (C++)☆15Nov 27, 2019Updated 6 years ago
- ☆38Oct 12, 2024Updated last year
- A high-performance serving system for DeepRec based on TensorFlow Serving.☆20Nov 15, 2023Updated 2 years ago
- ☆20May 11, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACM MM2025]: MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization☆44Aug 13, 2025Updated 11 months ago
- ☆21Jul 24, 2025Updated 11 months ago
- Source code for Practical DB-OS Co-Design with Privileged Kernel Bypass☆33Sep 9, 2025Updated 10 months ago
- Implementation of algorithms for memory optimized deep neural network training☆10Jul 23, 2020Updated 5 years ago
- Memory footprint reduction for transformer models☆11Jan 24, 2023Updated 3 years ago
- ☆10Dec 17, 2021Updated 4 years ago
- An experimental parallel training platform☆57Mar 25, 2024Updated 2 years ago
- (EuroSys'25) Towards VM Rescheduling Optimization Through Deep Reinforcement Learning☆26Mar 3, 2025Updated last year
- Mutual Distillation Learning For Person Re-identification☆19Jan 30, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Cavs: An Efficient Runtime System for Dynamic Neural Networks☆15Sep 18, 2020Updated 5 years ago
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- Accelerate database with GPU☆13Dec 30, 2013Updated 12 years ago
- 国产加速卡-海光DCU实战（大模型训练、微调、推理 等）☆93Aug 10, 2025Updated 11 months ago
- Cyclone Jet Rocket is a DDoS tool for System Security Technology course☆11Jun 5, 2017Updated 9 years ago
- ☆15Mar 3, 2024Updated 2 years ago
- ☆26May 9, 2025Updated last year
- SIGCOMM 2021 artifact☆12Jul 27, 2024Updated last year
- A workload for deploying LLM inference services on Kubernetes☆259Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- this is the release repository of superneurons☆54Feb 13, 2021Updated 5 years ago
- General-Purpose Kubernetes Pod Controller☆170Apr 4, 2023Updated 3 years ago
- Evaluate state-of-the-art GPU joins☆14Nov 29, 2023Updated 2 years ago
- Implementation of vDNN++; an improvement over vDNN☆18Dec 7, 2018Updated 7 years ago
- How to plot for papers, slides, demos, etc.☆10Apr 7, 2022Updated 4 years ago
- ☆150Jan 9, 2025Updated last year
- ☆32Jul 2, 2025Updated last year