PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
☆43Jan 31, 2024Updated 2 years ago
Alternatives and similar repositories for PipeEdge
Users that are interested in PipeEdge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆16Feb 21, 2025Updated last year
- PyTorch implementation of the paper: Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Le…☆46Oct 26, 2023Updated 2 years ago
- [TMC'22] SplitPlace: AI Augmented Splitting and Placement of Large-Scale Neural Networks in Mobile Edge Environments☆22Dec 8, 2022Updated 3 years ago
- [EMSOFT 2022] Adaptive Edge Offloading for Image Classification Under Rate Limit☆15Jul 17, 2023Updated 3 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 云边协同- collaborative inference📚Dynamic adaptive DNN surgery for inference acceleration on the edge☆46Jul 30, 2023Updated 3 years ago
- Jupiter is a fast, scalable, and resource-efficient collaborative edge-AI system for generative LLM inference.☆32Jul 3, 2026Updated 3 months ago
- 云边协同- collaborative inference📚工作汇总 📚 Collaborative Inference Work Summary☆101Jan 2, 2025Updated last year
- 云边协同- collaborative inference 📚Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge☆113Jul 29, 2023Updated 3 years ago
- A simulator for large energy-aware fog computing environments 🌱☆10Jul 8, 2021Updated 5 years ago
- This is the code for paper "AIHO: Enhancing Task Offloading and Reducing Latency in Serverless Multi-Edge-to-Cloud Systems".☆11Feb 3, 2024Updated 2 years ago
- This repository is established to store personal notes and annotated papers during daily research.☆200Jun 28, 2026Updated 3 months ago
- Three Agent-Based Simulation for Edge Computing in 5G and Beyond for the recent paper titled "Design and Simulation of a Hybrid Architect…☆20Oct 26, 2021Updated 4 years ago
- Official implementation of IEEE S&P 2025 paper "Prompt Inversion Attack against Collaborative Inference of Large Language Models"☆17Apr 27, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A curated list of early exiting (LLM, CV, NLP, etc)☆74Aug 21, 2024Updated 2 years ago
- Edge computing system for mUAV crowd identification and monitoring.☆11Oct 30, 2021Updated 4 years ago
- PyTorch implementation of the paper: Decomposing Vision Transformers for Collaborative Inference in Edge Devices☆18Jul 27, 2024Updated 2 years ago
- 5G-Slicer: An emulator for mobile IoT applications deployed over 5G network slices☆16Apr 28, 2022Updated 4 years ago
- Numerical Evaluation and Implementation of paper: Workflow Optimization for paper Parallel Split Learning (IEEE INFOCOM 2024).☆24Jul 15, 2026Updated 2 months ago
- Code for paper "JMDC: A Joint Model and Data Compression System for Deep Neural Networks Collaborative Computing in Edge-Cloud Networks"☆25Updated this week
- A Monte-Carlo simulator for Mobile Edge/Cloud Computing☆12Aug 22, 2023Updated 3 years ago
- HEFT and CPOP task scheduling algorithms☆12Dec 6, 2018Updated 7 years ago
- Code for the paper "Latency-Aware Generation of Single-Rate DAGs from Multi-Rate Task Sets" (RTAS 2020)☆15Sep 18, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Training Quantized Neural Networks with a Full-precision Auxiliary Module☆13Jun 19, 2020Updated 6 years ago
- Official repository for the paper "Deploying a smart queuing system on edge with Intel OpenVINO toolkit" [Springer-2021]☆14Sep 22, 2020Updated 6 years ago
- a high performance system for customized-precision distributed deep learning☆12Dec 10, 2020Updated 5 years ago
- ☆13Jun 29, 2024Updated 2 years ago
- Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection, backed by FedML, Inc.☆44Aug 1, 2022Updated 4 years ago
- A framework and specification language for simulating data based on graphical models☆19May 2, 2025Updated last year
- [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things☆58Aug 27, 2024Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Mar 7, 2024Updated 2 years ago
- Multi-branch model for concurrent execution☆18Jun 27, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- INFOCOM 2024: Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inference☆33Oct 13, 2024Updated 2 years ago
- The goal of this design is to use the PYNQ-Z2 development board to design a general convolution neural network accelerator. And through r…☆12Sep 30, 2020Updated 6 years ago
- ☆13Jul 24, 2026Updated 2 months ago
- Use Q-Learning to solve Job Shop Scheduling Problem ( JSP )☆15Dec 18, 2019Updated 6 years ago
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- ☆13Oct 18, 2023Updated 2 years ago
- A static DAG scheduling algorithm for heterogeneous systems using Mixed Integer Linear Programming . Implementation of "Optimization Tech…☆17Jun 19, 2013Updated 13 years ago