PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
☆42Jan 31, 2024Updated 2 years ago
Alternatives and similar repositories for PipeEdge
Users that are interested in PipeEdge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆16Feb 21, 2025Updated last year
- PyTorch implementation of the paper: Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Le…☆46Oct 26, 2023Updated 2 years ago
- SLO-aware Kubernetes scheduler for the Edge and Cloud☆15Apr 28, 2023Updated 3 years ago
- [TMC'22] SplitPlace: AI Augmented Splitting and Placement of Large-Scale Neural Networks in Mobile Edge Environments☆22Dec 8, 2022Updated 3 years ago
- A PyTorch Implementation for experiements in paper: Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge.☆17May 29, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- 云边协同- collaborative inference📚Dynamic adaptive DNN surgery for inference acceleration on the edge☆46Jul 30, 2023Updated 3 years ago
- Jupiter is a fast, scalable, and resource-efficient collaborative edge-AI system for generative LLM inference.☆29Jul 3, 2026Updated last month
- Genetic algorithms for the placement of services in Fog domains☆14Apr 4, 2022Updated 4 years ago
- 云边协同- collaborative inference📚工作汇总 📚 Collaborative Inference Work Summary☆101Jan 2, 2025Updated last year
- 云边协同- collaborative inference 📚Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge☆112Jul 29, 2023Updated 3 years ago
- A simulator for large energy-aware fog computing environments 🌱☆10Jul 8, 2021Updated 5 years ago
- This repository is established to store personal notes and annotated papers during daily research.☆200Jun 28, 2026Updated 2 months ago
- Three Agent-Based Simulation for Edge Computing in 5G and Beyond for the recent paper titled "Design and Simulation of a Hybrid Architect…☆20Oct 26, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A curated list of early exiting (LLM, CV, NLP, etc)☆74Aug 21, 2024Updated 2 years ago
- PyTorch implementation of the paper: Decomposing Vision Transformers for Collaborative Inference in Edge Devices☆18Jul 27, 2024Updated 2 years ago
- 5G-Slicer: An emulator for mobile IoT applications deployed over 5G network slices☆16Apr 28, 2022Updated 4 years ago
- Numerical Evaluation and Implementation of paper: Workflow Optimization for paper Parallel Split Learning (IEEE INFOCOM 2024).☆24Jul 15, 2026Updated last month
- Code for paper "JMDC: A Joint Model and Data Compression System for Deep Neural Networks Collaborative Computing in Edge-Cloud Networks"☆26Jul 22, 2026Updated last month
- A Monte-Carlo simulator for Mobile Edge/Cloud Computing☆12Aug 22, 2023Updated 3 years ago
- Code for the paper "Latency-Aware Generation of Single-Rate DAGs from Multi-Rate Task Sets" (RTAS 2020)☆16Sep 18, 2021Updated 4 years ago
- Training Quantized Neural Networks with a Full-precision Auxiliary Module☆13Jun 19, 2020Updated 6 years ago
- Official repository for the paper "Deploying a smart queuing system on edge with Intel OpenVINO toolkit" [Springer-2021]☆14Sep 22, 2020Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆13Jun 29, 2024Updated 2 years ago
- Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection, backed by FedML, Inc.☆44Aug 1, 2022Updated 4 years ago
- 签证官揭开关于美国学生签证申请的谣言☆11May 30, 2018Updated 8 years ago
- Rethinking Data-Free Quantization as a Zero-Sum Game☆10Oct 27, 2024Updated last year
- Pytorch implementation of ViT on CIFAR-10.☆16May 16, 2021Updated 5 years ago
- [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things☆58Aug 27, 2024Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Mar 7, 2024Updated 2 years ago
- Multi-branch model for concurrent execution☆18Jun 27, 2023Updated 3 years ago
- INFOCOM 2024: Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inference☆34Oct 13, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》☆25Dec 15, 2021Updated 4 years ago
- Showcase of various extension scenarios for SAP IoT Edge, intelligent edge computing software that provides "microservices at the edge" f…☆18Nov 16, 2022Updated 3 years ago
- Use Q-Learning to solve Job Shop Scheduling Problem ( JSP )☆15Dec 18, 2019Updated 6 years ago
- Layered prefill changes the scheduling axis from tokens to layers and removes redundant MoE weight reloads while keeping decode stall fre…☆19Mar 9, 2026Updated 5 months ago
- ☆17Feb 20, 2023Updated 3 years ago
- ☆13Oct 18, 2023Updated 2 years ago
- A static DAG scheduling algorithm for heterogeneous systems using Mixed Integer Linear Programming . Implementation of "Optimization Tech…☆17Jun 19, 2013Updated 13 years ago