This is a repository accompanying the survey Edge AI Meets LLM (coming soon), containing a comprehensive list of papers, codebases, toolchains, and open-source frameworks. It is intended to serve as a handbook for researchers and developers interested in Edge/Mobile LLMs.
☆17Jun 5, 2025Updated last year
Alternatives and similar repositories for Awesome-Edge-LLMs
Users that are interested in Awesome-Edge-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BGEMM-CUDA is a CUDA-based low-bit GEMM kernel library for efficient neural network inference. It implements optimized binary and ternary…☆20Aug 30, 2024Updated last year
- Neural Network Quantization With Fractional Bit-widths☆11Feb 19, 2021Updated 5 years ago
- PyTorch Quantization Framework For OCP MX Datatypes.☆16May 30, 2025Updated last year
- [ISCA 2025] Official Implementation of "MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization"☆24Oct 30, 2025Updated 8 months ago
- Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops☆30Mar 16, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆28Dec 2, 2024Updated last year
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆32Mar 7, 2024Updated 2 years ago
- ☆19Dec 10, 2021Updated 4 years ago
- Two-Stage ECG Signal Denoising Based Deep Convolutional Network☆13Nov 19, 2021Updated 4 years ago
- MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models☆27Apr 2, 2026Updated 3 months ago
- Source code and model weights for the PGGAN model utilised for the paper: Evaluating the Clinical Realism of Synthetic Chest X-Rays Gener…☆11Mar 2, 2021Updated 5 years ago
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 2 years ago
- some simulation models of various processes (just for fun)☆10Feb 5, 2024Updated 2 years ago
- experimental ui (underconstruction)☆15May 2, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- BEHRT: Transformer for Electronic Health Recrods☆12May 11, 2020Updated 6 years ago
- Run ops on Apple ANE in NPU register with pure python on M1 Asahi Linux. No Espresso, No CoreML, no metal, no .mlmodels file, no .hwx fil…☆16Jun 28, 2026Updated 3 weeks ago
- bitfusion verilog implementation☆13Feb 21, 2022Updated 4 years ago
- UniQL official repository (ICLR 2026)☆16Jan 27, 2026Updated 5 months ago
- ☆20Jan 1, 2026Updated 6 months ago
- Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)☆45Aug 19, 2021Updated 4 years ago
- ICLR 2021☆48Mar 18, 2021Updated 5 years ago
- Integrating Event-based Dynamic Vision Sensors with Sparse Hyperdimensional Computing☆13Jul 9, 2020Updated 6 years ago
- Deep Learning framework implemented from scratch in python using Numpy package.☆18Jan 28, 2020Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated 2 years ago
- This is a 3-layer SNN for MNIST☆15May 11, 2022Updated 4 years ago
- ☆15Feb 8, 2023Updated 3 years ago
- Android demo for dabnn☆20Oct 18, 2019Updated 6 years ago
- g2p for english tts☆19Nov 10, 2022Updated 3 years ago
- ☆10Mar 8, 2025Updated last year
- ☆28Aug 21, 2024Updated last year
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆23Jan 5, 2026Updated 6 months ago
- ☆123Nov 17, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆15Oct 26, 2022Updated 3 years ago
- Compass Apache TVM is enhanced based on the Apache TVM for wide range of Neural Network (NN) models quick support, optimization and heter…☆21May 6, 2026Updated 2 months ago
- Qwen-Image's DiT inference with TensorRT-10☆21Oct 13, 2025Updated 9 months ago
- This was my thesis topic in undergrad when I tried to track the heart beats from raw ECG signals. The intention was to build a model that…☆23Oct 14, 2024Updated last year
- ☆14Feb 26, 2026Updated 4 months ago
- yolov5训练转onnx转caffe工程 直接可用☆24Jan 10, 2022Updated 4 years ago
- Implementation of NM sparsity recipe presented in the paper "Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers".☆11Feb 5, 2024Updated 2 years ago