This is a repository accompanying the survey Edge AI Meets LLM (coming soon), containing a comprehensive list of papers, codebases, toolchains, and open-source frameworks. It is intended to serve as a handbook for researchers and developers interested in Edge/Mobile LLMs.
☆18Jun 5, 2025Updated last year
Alternatives and similar repositories for Awesome-Edge-LLMs
Users that are interested in Awesome-Edge-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BGEMM-CUDA is a CUDA-based low-bit GEMM kernel library for efficient neural network inference. It implements optimized binary and ternary…☆21Aug 30, 2024Updated 2 years ago
- ☆13Feb 24, 2021Updated 5 years ago
- PyTorch Quantization Framework For OCP MX Datatypes.☆16May 30, 2025Updated last year
- [ISCA 2025] Official Implementation of "MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization"☆26Oct 30, 2025Updated 11 months ago
- ☆29Dec 2, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Linear Algebra and Deep Learning Zig library with GPGPU and heterogeneous computing☆10Aug 26, 2026Updated 2 months ago
- Quick and dirty benchmarking tool to measure the performance of RK3588 NPU.☆12Feb 23, 2024Updated 2 years ago
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆34Mar 7, 2024Updated 2 years ago
- Simple working example of pytorch model deployed on android device using ncnn☆11Jul 15, 2022Updated 4 years ago
- Two-Stage ECG Signal Denoising Based Deep Convolutional Network☆13Nov 19, 2021Updated 4 years ago
- MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models☆32Apr 2, 2026Updated 6 months ago
- Source code and model weights for the PGGAN model utilised for the paper: Evaluating the Clinical Realism of Synthetic Chest X-Rays Gener…☆11Mar 2, 2021Updated 5 years ago
- A fine-tune framework based on pytorch-pretrained-BERT☆17Dec 8, 2022Updated 3 years ago
- GEMMs with metal☆26Oct 17, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 3 years ago
- AI agent that helps you learn Tinygrad and updates you on the bounties☆14Aug 5, 2025Updated last year
- ☆21Oct 6, 2026Updated 3 weeks ago
- BEHRT: Transformer for Electronic Health Recrods☆12May 11, 2020Updated 6 years ago
- ☆13Jan 31, 2024Updated 2 years ago
- Hardware reference and research notes for the RK3588 NPU and its regcmd interface☆27Oct 13, 2026Updated 2 weeks ago
- experimental ui (underconstruction)☆15May 2, 2025Updated last year
- Awesome Blockchain Articles☆14Jul 10, 2022Updated 4 years ago
- ICLR 2021☆50Mar 18, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)☆45Aug 19, 2021Updated 5 years ago
- Run ops on Apple ANE in NPU register with pure python on M1 Asahi Linux. No Espresso, No CoreML, no metal, no .mlmodels file, no .hwx fil…☆21Oct 8, 2026Updated 3 weeks ago
- ☆20Apr 12, 2023Updated 3 years ago
- This is a 3-layer SNN for MNIST☆15May 11, 2022Updated 4 years ago
- ☆12Jul 21, 2025Updated last year
- bitfusion verilog implementation☆13Feb 21, 2022Updated 4 years ago
- ☆15Feb 8, 2023Updated 3 years ago
- Operating System Course 2019@Beihang University(BUAA)☆19Sep 25, 2019Updated 7 years ago
- Matrix multiplication on the NPU inside RK3588☆18Jun 27, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆18Jan 4, 2025Updated last year
- ☆12Feb 22, 2024Updated 2 years ago
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"☆39Aug 20, 2024Updated 2 years ago
- Turing-pi BMC firmware☆30Oct 15, 2026Updated 2 weeks ago
- Official code repository for "Déjà Vu: Efficient Video-Language Query Engine with Learning-based Inter-Frame Computation Reuse [VLDB 25]"☆12Jul 8, 2026Updated 3 months ago
- 寒假入门小作业☆12Feb 25, 2019Updated 7 years ago
- Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU☆24Oct 13, 2026Updated 2 weeks ago