NexaAI / Awesome-LLMs-on-device
Awesome LLMs on Device: A Comprehensive Survey
β1,046Updated 2 months ago
Alternatives and similar repositories for Awesome-LLMs-on-device:
Users that are interested in Awesome-LLMs-on-device are comparing it to the libraries listed below
- Unified KV Cache Compression Methods for Auto-Regressive Modelsβ966Updated 2 months ago
- [ICLR 2025π₯] SVD-LLM & [NAACL 2025π₯] SVD-LLM V2β189Updated 2 weeks ago
- Fast Multimodal LLM on Mobile Devicesβ781Updated last week
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.β2,268Updated this week
- An acceleration library that supports arbitrary bit-width combinatorial quantization operationsβ219Updated 6 months ago
- Align Anything: Training All-modality Model with Feedbackβ3,063Updated last week
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Modelsβ249Updated 2 weeks ago
- A highly optimized LLM inference acceleration engine for Llama and its variants.β881Updated last week
- The official implementation of Self-Play Preference Optimization (SPPO)β515Updated 2 months ago
- Low-bit LLM inference on CPU with lookup tableβ705Updated 2 months ago
- [NeurIPS'24 Spotlight, ICLR'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which rβ¦β951Updated this week
- Survey Paper List - Efficient LLM and Foundation Modelsβ241Updated 6 months ago
- Easiest and laziest way for building multi-agent LLMs applications.β1,417Updated last week
- Build multimodal language agents for fast prototype and productionβ2,451Updated 2 weeks ago
- π° Must-read papers and blogs on Speculative Decoding β‘οΈβ661Updated this week
- xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelismβ1,722Updated last week
- minimal-cost for training 0.5B R1-Zeroβ673Updated this week
- Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.β1,113Updated last week
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"β709Updated this week
- adds Sequence Parallelism into LLaMA-Factoryβ437Updated last week
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Vβ¦β443Updated this week
- Fast inference from large lauguage models via speculative decodingβ700Updated 7 months ago
- [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Seβ¦β617Updated 3 weeks ago
- Paper list for Personal LLM Agentsβ377Updated 10 months ago
- [TMLR 2024] Efficient Large Language Models: A Surveyβ1,124Updated last month
- A curated list for Efficient Large Language Modelsβ1,575Updated last week
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilitiesγβ1,696Updated 2 months ago
- Large Language Model Agent: A Survey on Methodology, Applications and Challengesβ53Updated this week
- TinyChatEngine: On-Device LLM Inference Libraryβ826Updated 8 months ago
- Recipes to train reward model for RLHF.β1,262Updated last month