facebookresearch / MobileLLMLinks
MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
☆1,313Updated 4 months ago
Alternatives and similar repositories for MobileLLM
Users that are interested in MobileLLM are comparing it to the libraries listed below
Sorting:
- nanoGPT style version of Llama 3.1☆1,424Updated last year
- DataComp for Language Models☆1,361Updated 3 weeks ago
- Everything about the SmolLM and SmolVLM family of models☆3,168Updated 3 weeks ago
- MINT-1T: A one trillion token multimodal interleaved dataset.☆822Updated last year
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆907Updated 4 months ago
- TinyChatEngine: On-Device LLM Inference Library☆887Updated last year
- Minimalistic large language model 3D-parallelism training☆2,164Updated last week
- Official implementation of Half-Quadratic Quantization (HQQ)☆874Updated 2 weeks ago
- OLMoE: Open Mixture-of-Experts Language Models☆850Updated 5 months ago
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,583Updated last year
- Reaching LLaMA2 Performance with 0.1M Dollars☆988Updated last year
- Recipes to scale inference-time compute of open models☆1,112Updated 3 months ago
- TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones☆1,295Updated last year
- [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices☆658Updated 3 months ago
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,548Updated 4 months ago
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆653Updated 4 months ago
- Open weights language model from Google DeepMind, based on Griffin.☆649Updated 2 months ago
- Serving multiple LoRA finetuned LLM as one☆1,086Updated last year
- [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration☆3,229Updated last month
- A modern model graph visualizer and debugger☆1,308Updated this week
- Muon is Scalable for LLM Training☆1,289Updated last month
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,607Updated 3 weeks ago
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,852Updated last year
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆2,047Updated last year
- Scalable data pre processing and curation toolkit for LLMs☆1,106Updated this week
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,117Updated 3 weeks ago
- ☆864Updated last year
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,273Updated 5 months ago
- Code for BLT research paper☆1,974Updated 3 months ago
- A pytorch quantization backend for optimum☆985Updated last week