This is a repository accompanying the survey Edge AI Meets LLM (coming soon), containing a comprehensive list of papers, codebases, toolchains, and open-source frameworks. It is intended to serve as a handbook for researchers and developers interested in Edge/Mobile LLMs.
☆19Nov 5, 2026Updated 2 weeks ago
Alternatives and similar repositories for Awesome-Edge-LLMs
Users that are interested in Awesome-Edge-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Feb 24, 2021Updated 5 years ago
- PyTorch Quantization Framework For OCP MX Datatypes.☆16May 30, 2025Updated last year
- ☆29Dec 2, 2024Updated last year
- Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops☆30Mar 16, 2024Updated 2 years ago
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆34Mar 7, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆19Dec 10, 2021Updated 4 years ago
- MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models☆32Apr 2, 2026Updated 7 months ago
- Source code and model weights for the PGGAN model utilised for the paper: Evaluating the Clinical Realism of Synthetic Chest X-Rays Gener…☆11Mar 2, 2021Updated 5 years ago
- Yet Another Rockchip top-like Tool☆12Nov 9, 2025Updated last year
- LLM Inference with Microscaling Format☆35Nov 12, 2024Updated 2 years ago
- Code for the paper “SharQ: Bridging Activation Sparsity and FP4 Quantization for LLM Inference”☆15Oct 28, 2026Updated 3 weeks ago
- ☆12Mar 27, 2026Updated 7 months ago
- Detect Open or Closed mouth using Mediapipe Python☆11Aug 11, 2022Updated 4 years ago
- Awesome Blockchain Articles☆14Jul 10, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A list of papers for Graph Retrieval-Augmented Generation (GraphRAG).☆10Mar 13, 2025Updated last year
- ☆13Jan 31, 2024Updated 2 years ago
- ICLR 2021☆50Mar 18, 2021Updated 5 years ago
- Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)☆45Aug 19, 2021Updated 5 years ago
- ☆20Apr 12, 2023Updated 3 years ago
- Android demo for dabnn☆20Oct 18, 2019Updated 7 years ago
- This is a 3-layer SNN for MNIST☆15May 11, 2022Updated 4 years ago
- Code implementation of DuoGPT (NeurIPS 2025, https://arxiv.org/abs/2506.20194)☆10Sep 23, 2025Updated last year
- ☆12Sep 1, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- KEEP:Official code for "KEEP: A KV-Cache-Centric Memory Management System for Efficient Embodied Planning". A memory management system op…☆13Jul 9, 2026Updated 4 months ago
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated 2 years ago
- vLLM wall-clock emulation pluging to allow running the real vllm serve and benchmark without gpu with simple mocking☆17Aug 21, 2026Updated 2 months ago
- bitfusion verilog implementation☆13Feb 21, 2022Updated 4 years ago
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"☆39Aug 20, 2024Updated 2 years ago
- Matrix multiplication on the NPU inside RK3588☆18Jun 27, 2024Updated 2 years ago
- Official code repository for "Déjà Vu: Efficient Video-Language Query Engine with Learning-based Inter-Frame Computation Reuse [VLDB 25]"☆12Jul 8, 2026Updated 4 months ago
- ☆18Jan 4, 2025Updated last year
- ☆12Apr 14, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆31Nov 3, 2026Updated 2 weeks ago
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆24Jan 5, 2026Updated 10 months ago
- ☆22Jan 1, 2026Updated 10 months ago
- ☆24Oct 6, 2026Updated last month
- Deep Learning framework implemented from scratch in python using Numpy package.☆18Jan 28, 2020Updated 6 years ago
- Matrix multiplication and LLM serving kernels for RK3588 RKNPU2. (like FlashInfer but for RKNPU2!)☆23Nov 4, 2026Updated 2 weeks ago
- This repository contains the artifacts for the MLSys 2026 paper AgenticCache.☆13Apr 22, 2026Updated 6 months ago
Are these results useful?