PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
☆38Jan 31, 2024Updated 2 years ago
Alternatives and similar repositories for PipeEdge
Users that are interested in PipeEdge are comparing it to the libraries listed below
Sorting:
- PyTorch implementation of the paper: Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Le…☆46Oct 26, 2023Updated 2 years ago
- [EMSOFT 2022] Adaptive Edge Offloading for Image Classification Under Rate Limit☆15Jul 17, 2023Updated 2 years ago
- [TMC'22] SplitPlace: AI Augmented Splitting and Placement of Large-Scale Neural Networks in Mobile Edge Environments☆21Dec 8, 2022Updated 3 years ago
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆16Feb 21, 2025Updated last year
- 云边协同- collaborative inference 📚Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge☆104Jul 29, 2023Updated 2 years ago
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆37Aug 29, 2025Updated 6 months ago
- PyTorch implementation of the paper: Decomposing Vision Transformers for Collaborative Inference in Edge Devices☆18Jul 27, 2024Updated last year
- This is the code for paper "AIHO: Enhancing Task Offloading and Reducing Latency in Serverless Multi-Edge-to-Cloud Systems".☆12Feb 3, 2024Updated 2 years ago
- A PyTorch Implementation for experiements in paper: Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge.☆17May 29, 2023Updated 2 years ago
- Three Agent-Based Simulation for Edge Computing in 5G and Beyond for the recent paper titled "Design and Simulation of a Hybrid Architect…☆20Oct 26, 2021Updated 4 years ago
- Code for paper "JMDC: A Joint Model and Data Compression System for Deep Neural Networks Collaborative Computing in Edge-Cloud Networks"☆25Aug 24, 2025Updated 6 months ago
- Edge computing system for mUAV crowd identification and monitoring.☆11Oct 30, 2021Updated 4 years ago
- 5G-Slicer: An emulator for mobile IoT applications deployed over 5G network slices☆16Apr 28, 2022Updated 3 years ago
- Training Quantized Neural Networks with a Full-precision Auxiliary Module☆13Jun 19, 2020Updated 5 years ago
- [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things☆59Aug 27, 2024Updated last year
- Multi-branch model for concurrent execution☆18Jun 27, 2023Updated 2 years ago
- The goal of this design is to use the PYNQ-Z2 development board to design a general convolution neural network accelerator. And through r…☆11Sep 30, 2020Updated 5 years ago
- An Chrome Extension Printing any page to your Boox reader!（via send2boox.com "Push"）☆12Apr 6, 2021Updated 4 years ago
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- ☆14Oct 18, 2023Updated 2 years ago
- WWDC 2020 Swift Student Challenge Submission "6 Feet Between" by Tony Tang☆10Jun 17, 2020Updated 5 years ago
- Interface Xilinx XDMA PCIe with DDR3 using MIG-IP on Artix-7 FPGA using Nitefury dev board☆18Apr 13, 2022Updated 3 years ago
- ☆24Aug 15, 2023Updated 2 years ago
- ☆14Aug 2, 2023Updated 2 years ago
- SCARIF is a tool to estimate the embodied carbon emissions of data center servers with accelerator hardware (GPUs, FPGAs, etc.)☆15Updated this week
- A pytorch implementation of the ICCV2021 workshop paper SimDis: Simple Distillation Baselines for Improving Small Self-supervised Models☆14Jul 15, 2021Updated 4 years ago
- Sparse CNN Accelerator targeting Intel FPGA☆12Aug 26, 2021Updated 4 years ago
- ☆14Oct 6, 2023Updated 2 years ago
- This repository provides a simulation to schedule tasks in edge-fog environment. The algorithm tries to find optimized fog nodes when a …☆25Jan 1, 2022Updated 4 years ago
- 一个全平台的 Python CPU 性能测试工具及榜单。☆15Nov 11, 2023Updated 2 years ago
- Python-based modeling and simulation framework for Edge Computing resource management policies☆101Jun 10, 2025Updated 9 months ago
- Official PyTorch implementation of "LGViT: Dynamic Early Exiting for Accelerating Vision Transformer" (ACM MM 2023)☆15Nov 18, 2024Updated last year
- detect UAV based on YOLOv5 and siamRPN☆10Oct 20, 2021Updated 4 years ago
- ☆16Apr 15, 2025Updated 11 months ago
- [CVPR'20] ZeroQ Mixed-Precision implementation (unofficial): A Novel Zero Shot Quantization Framework☆14Dec 16, 2020Updated 5 years ago
- copyright management system using ERC721 token on a blockchain☆11Dec 1, 2020Updated 5 years ago
- Code needed to reproduce results from my ICLR 2019 paper on fixed-point quantization of the backprop algorithm.☆10Jan 24, 2019Updated 7 years ago
- ☆13Jan 14, 2020Updated 6 years ago
- Shielded Enclaves for Cloud FPGAs☆15Nov 24, 2021Updated 4 years ago