stevelaskaridis / awesome-mobile-llmLinks
Awesome Mobile LLMs
☆210Updated last week
Alternatives and similar repositories for awesome-mobile-llm
Users that are interested in awesome-mobile-llm are comparing it to the libraries listed below
Sorting:
- ☆58Updated 8 months ago
- High-speed and easy-use LLM serving framework for local deployment☆112Updated 4 months ago
- Fast Multimodal LLM on Mobile Devices☆958Updated last month
- TinyChatEngine: On-Device LLM Inference Library☆871Updated last year
- Awesome list for LLM quantization☆252Updated last month
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆647Updated 2 months ago
- ☆214Updated 5 months ago
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆65Updated 9 months ago
- Simple extension on vLLM to help you speed up reasoning model without training.☆167Updated last month
- TPI-LLM: Serving 70b-scale LLMs Efficiently on Low-resource Edge Devices☆185Updated last month
- A family of compressed models obtained via pruning and knowledge distillation☆344Updated 8 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆318Updated 2 months ago
- Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU. Seamlessly integrated with Torchao, Tra…☆528Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆405Updated this week
- A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..☆191Updated 6 months ago
- codebase for "MELTing Point: Mobile Evaluation of Language Transformers"☆18Updated 11 months ago
- For releasing code related to compression methods for transformers, accompanying our publications☆435Updated 6 months ago
- 1.58 Bit LLM on Apple Silicon using MLX☆214Updated last year
- Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model☆222Updated last month
- scalable and robust tree-based speculative decoding algorithm☆349Updated 5 months ago
- [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.☆827Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆265Updated 9 months ago
- ☆95Updated 9 months ago
- An innovative library for efficient LLM inference via low-bit quantization☆349Updated 10 months ago
- [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models☆277Updated last month
- ☆84Updated last month
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆302Updated 5 months ago
- [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models☆171Updated 6 months ago
- A curated list of awesome resources, tools, research papers, and projects related to the concept of Large Language Model Operating System…☆125Updated 2 months ago
- Survey Paper List - Efficient LLM and Foundation Models☆252Updated 9 months ago