[Artificial Intelligence Review 2026] Awesome list and resources for on-device LLMs: model compression, system optimization, and edge deployment.
☆43Aug 4, 2026Updated last week
Alternatives and similar repositories for Awesome-On-Device-LLMs
Users that are interested in Awesome-On-Device-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimalist Vision with Freeform Pixels (ECCV 24)☆13Dec 30, 2024Updated last year
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- ☆11Jun 13, 2024Updated 2 years ago
- Use FPGA to Transfer Image with Gigabits Ethernet☆19Dec 2, 2020Updated 5 years ago
- ☆16Sep 27, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Sep 25, 2023Updated 2 years ago
- Vibe Coding A GPGPU via Cursor + Gemini3 Pro☆83Nov 23, 2025Updated 8 months ago
- ☆79Sep 19, 2025Updated 10 months ago
- Zircon CPU in 2024☆13Nov 21, 2025Updated 8 months ago
- The Code for Homeomorphic Projection☆14Sep 21, 2023Updated 2 years ago
- 官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。☆16Sep 25, 2023Updated 2 years ago
- 提供一种Matlab绘制直线箭头以及非线性箭头的方式，可用以绘制坐标轴箭头。☆15Jul 13, 2020Updated 6 years ago
- Master’s thesis project focused on developing an Active Vision system to enhance exploration in agricultural environments using Zero‑Shot…☆20Feb 27, 2025Updated last year
- Official PyTorch implementation of "Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming" (ICML'23)☆13Apr 13, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [DAC 2026] FlashFPS☆15Jun 1, 2026Updated 2 months ago
- Robust Federated Learning for Large Language Models in Adversarial Wireless Environments☆16Mar 7, 2025Updated last year
- arxiv翻译修复器！☆22Nov 13, 2024Updated last year
- ☆21Feb 5, 2024Updated 2 years ago
- A family of efficient edge language models in 100M~1B sizes.☆19Feb 14, 2025Updated last year
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆15Mar 20, 2025Updated last year
- ☆44Updated this week
- This repository contains optimized training recipes for a variety of machine learning models on Tenstorrent hardware, powered by the TT-F…☆16Updated this week
- [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆77Jul 8, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This is our solution to MCM 2019 problem C. Spread maps (gif), codes and thinking behind the model are provided☆13Jul 26, 2019Updated 7 years ago
- This repository contains low-bit quantization papers from 2020 to 2026 on top conference.☆205Jun 25, 2026Updated last month
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆52Jul 21, 2025Updated last year
- Github repo for ICLR-2025 paper, Fine-tuning Large Language Models with Sparse Matrices☆26Feb 2, 2026Updated 6 months ago
- Hexo的博客搭建教程☆17Mar 2, 2020Updated 6 years ago
- This is the official implementation for the paper: Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models☆19Sep 11, 2024Updated last year
- A fork of Xiangshan for AI☆56Updated this week
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆23Mar 15, 2024Updated 2 years ago
- Notes I prepared for final examinations at NJU CS.（我的南京大学计算机系期末复习材料）☆34Aug 22, 2021Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [Re] Object Detection Meets Knowledge Graphs☆21Feb 3, 2023Updated 3 years ago
- Artifact of Chimera☆18May 6, 2025Updated last year
- Awesome MoE Diffusion Models☆21Mar 25, 2026Updated 4 months ago
- whatever it means☆19Jun 10, 2026Updated 2 months ago
- MICRO 2024 Evaluation Artifact for FuseMax☆17Aug 26, 2024Updated last year
- ☆15Dec 15, 2023Updated 2 years ago
- ☆20Oct 6, 2023Updated 2 years ago