This is a repository accompanying the survey Edge AI Meets LLM (coming soon), containing a comprehensive list of papers, codebases, toolchains, and open-source frameworks. It is intended to serve as a handbook for researchers and developers interested in Edge/Mobile LLMs.
☆17Jun 5, 2025Updated last year
Alternatives and similar repositories for Awesome-Edge-LLMs
Users that are interested in Awesome-Edge-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BGEMM-CUDA is a CUDA-based low-bit GEMM kernel library for efficient neural network inference. It implements optimized binary and ternary…☆20Aug 30, 2024Updated 2 years ago
- Neural Network Quantization With Fractional Bit-widths☆11Feb 19, 2021Updated 5 years ago
- PyTorch Quantization Framework For OCP MX Datatypes.☆16May 30, 2025Updated last year
- [ISCA 2025] Official Implementation of "MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization"☆25Oct 30, 2025Updated 10 months ago
- ☆28Dec 2, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆32Mar 7, 2024Updated 2 years ago
- ☆19Dec 10, 2021Updated 4 years ago
- MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models☆30Apr 2, 2026Updated 4 months ago
- Power equipment image data☆20Nov 6, 2025Updated 9 months ago
- Two-Stage ECG Signal Denoising Based Deep Convolutional Network☆13Nov 19, 2021Updated 4 years ago
- bitfusion verilog implementation☆13Feb 21, 2022Updated 4 years ago
- UniQL official repository (ICLR 2026)☆19Jan 27, 2026Updated 7 months ago
- ☆21Jan 1, 2026Updated 7 months ago
- Awesome Blockchain Articles☆14Jul 10, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)☆45Aug 19, 2021Updated 5 years ago
- ICLR 2021☆48Mar 18, 2021Updated 5 years ago
- Integrating Event-based Dynamic Vision Sensors with Sparse Hyperdimensional Computing☆13Jul 9, 2020Updated 6 years ago
- ☆20Apr 12, 2023Updated 3 years ago
- This is a 3-layer SNN for MNIST☆15May 11, 2022Updated 4 years ago
- Android demo for dabnn☆20Oct 18, 2019Updated 6 years ago
- ☆10Mar 8, 2025Updated last year
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"☆39Aug 20, 2024Updated 2 years ago
- ☆124Nov 17, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆15Oct 26, 2022Updated 3 years ago
- Qwen-Image's DiT inference with TensorRT-10☆21Oct 13, 2025Updated 10 months ago
- This was my thesis topic in undergrad when I tried to track the heart beats from raw ECG signals. The intention was to build a model that…☆23Oct 14, 2024Updated last year
- ☆14Feb 26, 2026Updated 6 months ago
- Implementation of NM sparsity recipe presented in the paper "Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers".☆11Feb 5, 2024Updated 2 years ago
- ☆21Mar 2, 2026Updated 5 months ago
- ☆12Aug 18, 2023Updated 3 years ago
- LLM Inference with Microscaling Format☆35Nov 12, 2024Updated last year
- ☆13Jun 29, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jul 24, 2018Updated 8 years ago
- The official code for [ECCV2020] "HALO: Hardware-aware Learning to Optimize"☆10Mar 22, 2023Updated 3 years ago
- [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better☆16Feb 15, 2025Updated last year
- ☆15Mar 21, 2025Updated last year
- 3D-ResNeXt101 with Grad-CAM Demo. (Pytorch)☆24Sep 12, 2020Updated 5 years ago
- Code for the papers: “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling” and “Adaptive Block-Scaled Data Types”☆202Apr 21, 2026Updated 4 months ago
- Awesome Quantization Paper lists with Codes☆10Feb 24, 2021Updated 5 years ago