PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
☆44Jan 31, 2024Updated 2 years ago
Alternatives and similar repositories for PipeEdge
Users that are interested in PipeEdge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of the paper: Decomposing Vision Transformers for Collaborative Inference in Edge Devices☆18Jul 27, 2024Updated 2 years ago
- PyTorch implementation of the paper: Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Le…☆46Oct 26, 2023Updated 3 years ago
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆16Feb 21, 2025Updated last year
- 云边协同- collaborative inference📚Dynamic adaptive DNN surgery for inference acceleration on the edge☆45Jul 30, 2023Updated 3 years ago
- 云边协同- collaborative inference 📚Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge☆112Jul 29, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Code for paper "JMDC: A Joint Model and Data Compression System for Deep Neural Networks Collaborative Computing in Edge-Cloud Networks"☆26Oct 8, 2026Updated 3 weeks ago
- SLO-aware Kubernetes scheduler for the Edge and Cloud☆16Apr 28, 2023Updated 3 years ago
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆41Aug 29, 2025Updated last year
- [EMSOFT 2022] Adaptive Edge Offloading for Image Classification Under Rate Limit☆15Jul 17, 2023Updated 3 years ago
- 云边协同- collaborative inference📚工作汇总 📚 Collaborative Inference Work Summary☆101Jan 2, 2025Updated last year
- A PyTorch Implementation for experiements in paper: Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge.☆17May 29, 2023Updated 3 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- Genetic algorithms for the placement of services in Fog domains☆14Apr 4, 2022Updated 4 years ago
- A simulator for large energy-aware fog computing environments 🌱☆10Jul 8, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is the code for paper "AIHO: Enhancing Task Offloading and Reducing Latency in Serverless Multi-Edge-to-Cloud Systems".☆11Feb 3, 2024Updated 2 years ago
- Edge computing system for mUAV crowd identification and monitoring.☆11Oct 30, 2021Updated 5 years ago
- Three Agent-Based Simulation for Edge Computing in 5G and Beyond for the recent paper titled "Design and Simulation of a Hybrid Architect…☆20Oct 26, 2021Updated 5 years ago
- This repository is established to store personal notes and annotated papers during daily research.☆200Jun 28, 2026Updated 4 months ago
- 5G-Slicer: An emulator for mobile IoT applications deployed over 5G network slices☆16Apr 28, 2022Updated 4 years ago
- distributed CNN inference at the edge, extend ncnn with CUDA, MPI+OPENMP support.☆24Aug 19, 2025Updated last year
- Shared Memory-contention-aware Concurrent DNN Execution for Diversely Heterogeneous System-on-Chips☆11Jan 4, 2024Updated 2 years ago
- HEFT and CPOP task scheduling algorithms☆12Dec 6, 2018Updated 7 years ago
- Privacy-aware service migration strategy for edge computing environments☆13Jun 17, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Monte-Carlo simulator for Mobile Edge/Cloud Computing☆12Aug 22, 2023Updated 3 years ago
- Training Quantized Neural Networks with a Full-precision Auxiliary Module☆13Jun 19, 2020Updated 6 years ago
- a high performance system for customized-precision distributed deep learning☆12Dec 10, 2020Updated 5 years ago
- Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection, backed by FedML, Inc.☆44Aug 1, 2022Updated 4 years ago
- Official repository for the paper "Deploying a smart queuing system on edge with Intel OpenVINO toolkit" [Springer-2021]☆14Sep 22, 2020Updated 6 years ago
- Code for the paper "Latency-Aware Generation of Single-Rate DAGs from Multi-Rate Task Sets" (RTAS 2020)☆15Sep 18, 2021Updated 5 years ago
- Multi-branch model for concurrent execution☆17Jun 27, 2023Updated 3 years ago
- 签证官揭开关于美国学生签证申请的谣言☆10May 30, 2018Updated 8 years ago
- Python-based modeling and simulation framework for Edge Computing resource management policies☆110May 1, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Showcase of various extension scenarios for SAP IoT Edge, intelligent edge computing software that provides "microservices at the edge" f…☆18Nov 16, 2022Updated 3 years ago
- ☆16May 11, 2023Updated 3 years ago
- Rethinking Data-Free Quantization as a Zero-Sum Game☆10Oct 27, 2024Updated 2 years ago
- [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things☆58Aug 27, 2024Updated 2 years ago
- Autodidactic Neurosurgeon Collaborative Deep Inference for Mobile Edge Intelligence via Online Learning☆43Aug 14, 2021Updated 5 years ago
- WWDC 2020 Swift Student Challenge Submission "6 Feet Between" by Tony Tang☆10Jun 17, 2020Updated 6 years ago
- ☆13Jun 29, 2024Updated 2 years ago