parrotsky / AutoDiCELinks
distributed CNN inference at the edge, extend ncnn with CUDA, MPI+OPENMP support.
☆21Updated 2 months ago
Alternatives and similar repositories for AutoDiCE
Users that are interested in AutoDiCE are comparing it to the libraries listed below
Sorting:
- This is a list of awesome edgeAI inference related papers.☆98Updated last year
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆35Updated last year
- [CVPRW 2021] Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platforms☆30Updated 2 years ago
- ☆78Updated 2 years ago
- A Portable C Library for Distributed CNN Inference on IoT Edge Clusters☆85Updated 5 years ago
- Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"☆56Updated 9 months ago
- MobiSys#114☆22Updated 2 years ago
- To deploy Transformer models in CV to mobile devices.☆18Updated 3 years ago
- Official implementation for ECCV 2022 paper LIMPQ - "Mixed-Precision Neural Network Quantization via Learned Layer-wise Importance"☆62Updated 2 years ago
- [DAC 2024] EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive La…☆71Updated last year
- Multi-branch model for concurrent execution☆18Updated 2 years ago
- Fast NPU-aware Neural Architecture Search☆22Updated 4 years ago
- TQT's pytorch implementation.☆21Updated 3 years ago
- Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"☆22Updated 4 years ago
- ☆36Updated 6 years ago
- Jetson embedded platform-target deep learning inference acceleration framework with TensorRT☆29Updated 3 weeks ago
- The code for paper: Neuralpower: Predict and deploy energy-efficient convolutional neural networks☆21Updated 6 years ago
- zTT: Learning-based DVFS with Zero Thermal Throttling for Mobile Devices [MobiSys'21] - Artifact Evaluation☆26Updated 4 years ago
- A Out-of-box PyTorch Scaffold for Neural Network Quantization-Aware-Training (QAT) Research. Website: https://github.com/zhutmost/neuralz…☆25Updated 2 years ago
- [FPGA'21] CoDeNet is an efficient object detection model on PyTorch, with SOTA performance on VOC and COCO based on CenterNet and Co-Desi…☆27Updated 2 years ago
- [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…☆55Updated last year
- About DNN compression and acceleration on Edge Devices.☆57Updated 4 years ago
- ☆25Updated last year
- Create tiny ML systems for on-device learning.☆20Updated 4 years ago
- Paper list for accleration of transformers☆13Updated 2 years ago
- A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.☆360Updated last year
- You Only Search Once: On Lightweight Differentiable Architecture Search for Resource-Constrained Embedded Platforms☆11Updated 2 years ago
- An external memory allocator example for PyTorch.☆16Updated 2 months ago
- Implementation of "NITI: Training Integer Neural Networks Using Integer-only Arithmetic" on arxiv☆86Updated 3 years ago
- ☆14Updated 4 years ago