PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
☆41Jan 31, 2024Updated 2 years ago
Alternatives and similar repositories for PipeEdge
Users that are interested in PipeEdge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆16Feb 21, 2025Updated last year
- PyTorch implementation of the paper: Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Le…☆47Oct 26, 2023Updated 2 years ago
- SLO-aware Kubernetes scheduler for the Edge and Cloud☆15Apr 28, 2023Updated 3 years ago
- [TMC'22] SplitPlace: AI Augmented Splitting and Placement of Large-Scale Neural Networks in Mobile Edge Environments☆22Dec 8, 2022Updated 3 years ago
- [EMSOFT 2022] Adaptive Edge Offloading for Image Classification Under Rate Limit☆15Jul 17, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆32Nov 16, 2024Updated last year
- 云边协同- collaborative inference📚Dynamic adaptive DNN surgery for inference acceleration on the edge☆46Jul 30, 2023Updated 2 years ago
- Jupiter is a fast, scalable, and resource-efficient collaborative edge-AI system for generative LLM inference.☆28Jul 3, 2026Updated 3 weeks ago
- Genetic algorithms for the placement of services in Fog domains☆14Apr 4, 2022Updated 4 years ago
- 云边协同- collaborative inference📚工作汇总 📚 Collaborative Inference Work Summary☆100Jan 2, 2025Updated last year
- 云边协同- collaborative inference 📚Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge☆112Jul 29, 2023Updated 2 years ago
- A simulator for large energy-aware fog computing environments 🌱☆10Jul 8, 2021Updated 5 years ago
- This repository is established to store personal notes and annotated papers during daily research.☆201Jun 28, 2026Updated 3 weeks ago
- Three Agent-Based Simulation for Edge Computing in 5G and Beyond for the recent paper titled "Design and Simulation of a Hybrid Architect…☆20Oct 26, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Edge computing system for mUAV crowd identification and monitoring.☆11Oct 30, 2021Updated 4 years ago
- A curated list of early exiting (LLM, CV, NLP, etc)☆74Aug 21, 2024Updated last year
- 5G-Slicer: An emulator for mobile IoT applications deployed over 5G network slices☆16Apr 28, 2022Updated 4 years ago
- Numerical Evaluation and Implementation of paper: Workflow Optimization for paper Parallel Split Learning (IEEE INFOCOM 2024).☆24Jul 15, 2026Updated last week
- A Monte-Carlo simulator for Mobile Edge/Cloud Computing☆12Aug 22, 2023Updated 2 years ago
- Privacy-aware service migration strategy for edge computing environments☆13Jun 17, 2022Updated 4 years ago
- Official repository for the paper "Deploying a smart queuing system on edge with Intel OpenVINO toolkit" [Springer-2021]☆14Sep 22, 2020Updated 5 years ago
- Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection, backed by FedML, Inc.☆44Aug 1, 2022Updated 3 years ago
- 签证官揭开关于美国学生签证申请的谣言☆11May 30, 2018Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A framework and specification language for simulating data based on graphical models☆19May 2, 2025Updated last year
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Mar 7, 2024Updated 2 years ago
- Multi-branch model for concurrent execution☆18Jun 27, 2023Updated 3 years ago
- INFOCOM 2024: Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inference☆34Oct 13, 2024Updated last year
- The goal of this design is to use the PYNQ-Z2 development board to design a general convolution neural network accelerator. And through r…☆11Sep 30, 2020Updated 5 years ago
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- WWDC 2020 Swift Student Challenge Submission "6 Feet Between" by Tony Tang☆10Jun 17, 2020Updated 6 years ago
- ☆18Feb 20, 2023Updated 3 years ago
- Unofficial wheels for some machine-learning Python libraries, for the Nvidia Jetson Nano.☆18Aug 24, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Work in progress LLM framework.☆16Oct 31, 2024Updated last year
- docker compose outline☆11Apr 22, 2023Updated 3 years ago
- Sparse CNN Accelerator targeting Intel FPGA☆15Aug 26, 2021Updated 4 years ago
- A system-level domain-specific systems-on-chip simulation framework☆20Nov 21, 2022Updated 3 years ago
- bitfusion verilog implementation☆13Feb 21, 2022Updated 4 years ago
- ☆13Oct 6, 2023Updated 2 years ago
- Python-based modeling and simulation framework for Edge Computing resource management policies☆105May 1, 2026Updated 2 months ago