PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
☆41Jan 31, 2024Updated 2 years ago
Alternatives and similar repositories for PipeEdge
Users that are interested in PipeEdge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆16Feb 21, 2025Updated last year
- PyTorch implementation of the paper: Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Le…☆47Oct 26, 2023Updated 2 years ago
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆39Aug 29, 2025Updated 11 months ago
- [TMC'22] SplitPlace: AI Augmented Splitting and Placement of Large-Scale Neural Networks in Mobile Edge Environments☆22Dec 8, 2022Updated 3 years ago
- [EMSOFT 2022] Adaptive Edge Offloading for Image Classification Under Rate Limit☆15Jul 17, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 云边协同- collaborative inference📚Dynamic adaptive DNN surgery for inference acceleration on the edge☆46Jul 30, 2023Updated 3 years ago
- Jupiter is a fast, scalable, and resource-efficient collaborative edge-AI system for generative LLM inference.☆28Jul 3, 2026Updated last month
- 云边协同- collaborative inference📚工作汇总 📚 Collaborative Inference Work Summary☆101Jan 2, 2025Updated last year
- 云边协同- collaborative inference 📚Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge☆112Jul 29, 2023Updated 3 years ago
- This is the code for paper "AIHO: Enhancing Task Offloading and Reducing Latency in Serverless Multi-Edge-to-Cloud Systems".☆11Feb 3, 2024Updated 2 years ago
- This repository is established to store personal notes and annotated papers during daily research.☆201Jun 28, 2026Updated last month
- Three Agent-Based Simulation for Edge Computing in 5G and Beyond for the recent paper titled "Design and Simulation of a Hybrid Architect…☆20Oct 26, 2021Updated 4 years ago
- Official implementation of IEEE S&P 2025 paper "Prompt Inversion Attack against Collaborative Inference of Large Language Models"☆16Apr 27, 2025Updated last year
- A curated list of early exiting (LLM, CV, NLP, etc)☆74Aug 21, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Edge computing system for mUAV crowd identification and monitoring.☆11Oct 30, 2021Updated 4 years ago
- 5G-Slicer: An emulator for mobile IoT applications deployed over 5G network slices☆16Apr 28, 2022Updated 4 years ago
- Numerical Evaluation and Implementation of paper: Workflow Optimization for paper Parallel Split Learning (IEEE INFOCOM 2024).☆24Jul 15, 2026Updated 3 weeks ago
- A Monte-Carlo simulator for Mobile Edge/Cloud Computing☆12Aug 22, 2023Updated 2 years ago
- Privacy-aware service migration strategy for edge computing environments☆13Jun 17, 2022Updated 4 years ago
- Training Quantized Neural Networks with a Full-precision Auxiliary Module☆13Jun 19, 2020Updated 6 years ago
- Official repository for the paper "Deploying a smart queuing system on edge with Intel OpenVINO toolkit" [Springer-2021]☆14Sep 22, 2020Updated 5 years ago
- a high performance system for customized-precision distributed deep learning☆12Dec 10, 2020Updated 5 years ago
- ☆13Jun 29, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection, backed by FedML, Inc.☆44Aug 1, 2022Updated 4 years ago
- 签证官揭开关于美国学生签证申请的谣言☆11May 30, 2018Updated 8 years ago
- [COLM'25] CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing☆19Jun 25, 2025Updated last year
- Rethinking Data-Free Quantization as a Zero-Sum Game☆10Oct 27, 2024Updated last year
- Pytorch implementation of ViT on CIFAR-10.☆16May 16, 2021Updated 5 years ago
- A framework and specification language for simulating data based on graphical models☆19May 2, 2025Updated last year
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Mar 7, 2024Updated 2 years ago
- INFOCOM 2024: Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inference☆34Oct 13, 2024Updated last year
- Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》☆25Dec 15, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Showcase of various extension scenarios for SAP IoT Edge, intelligent edge computing software that provides "microservices at the edge" f…☆18Nov 16, 2022Updated 3 years ago
- WWDC 2020 Swift Student Challenge Submission "6 Feet Between" by Tony Tang☆10Jun 17, 2020Updated 6 years ago
- ☆17Feb 20, 2023Updated 3 years ago
- ☆13Oct 18, 2023Updated 2 years ago
- [INFOCOM 2024 Top 1 Popular Article] Agglomerative Federated Learning: Empowering Larger Model Training via End-Edge-Cloud Collaboration☆82Jan 1, 2025Updated last year
- Vocabulary Parallelism☆26Mar 10, 2025Updated last year
- Unofficial wheels for some machine-learning Python libraries, for the Nvidia Jetson Nano.☆18Aug 24, 2021Updated 4 years ago