NexaAI / Awesome-LLMs-on-device
Awesome LLMs on Device: A Comprehensive Survey
☆907Updated last month
Related projects ⓘ
Alternatives and complementary repositories for Awesome-LLMs-on-device
- The Official Implementation of PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling☆524Updated this week
- An acceleration library that supports arbitrary bit-width combinatorial quantization operations☆224Updated last month
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆768Updated 2 months ago
- Accelerating the development of large multimodal models (LMMs) with lmms-eval☆1,936Updated this week
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,498Updated this week
- The official implementation of Self-Play Preference Optimization (SPPO)☆491Updated 3 months ago
- Easiest and laziest way for building multi-agent LLMs applications.☆1,016Updated this week
- A Streamlined Multimodal Agent Framework for Smart Hardware and More☆1,116Updated this week
- AI for all: Build the large graph of the language models☆238Updated 5 months ago
- Recipes to train reward model for RLHF.☆788Updated this week
- "AnyGraph: Graph Foundation Model in the Wild"☆185Updated last month
- Fast Multimodal LLM on Mobile Devices☆507Updated this week
- An MBTI Exploration of Large Language Models☆471Updated 9 months ago
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆208Updated last month
- 【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models☆1,821Updated this week
- The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://a…☆353Updated last month
- A tutorial based on MetaGPT to quickly help you understand the concept of agent and muti-agent and get started with coding development. 基…☆1,357Updated 5 months ago
- Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language m…☆3,175Updated this week
- Large Reasoning Models☆457Updated this week
- A deployment, monitoring and autoscaling service towards serverless LLM serving.☆161Updated this week
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆229Updated 2 months ago
- A recipe for online RLHF and online iterative DPO.☆413Updated this week
- [NeurIPS'24 Spotlight] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces in…☆776Updated this week
- LLM-based text extraction from unstructured data like PDFs, Words and HTMLs. Transform and cluster the text into your desired format. Les…☆185Updated 5 months ago
- Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)☆815Updated this week
- A curated list of awesome leaderboard-oriented resources for foundation models☆192Updated this week
- Real-time and accurate open-vocabulary end-to-end object detection☆1,525Updated 2 months ago
- improve Llama-2's proficiency in comprehension, generation, and translation of Chinese.☆531Updated 7 months ago
- Industrial-first evaluation benchmark for LLMs in the DevOps/AIOps domain.☆682Updated 3 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,260Updated last month