facebookresearch / MobileLLMLinks
MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
☆1,406Updated 9 months ago
Alternatives and similar repositories for MobileLLM
Users that are interested in MobileLLM are comparing it to the libraries listed below
Sorting:
- DataComp for Language Models☆1,413Updated 5 months ago
- TinyChatEngine: On-Device LLM Inference Library☆939Updated last year
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆944Updated 2 months ago
- 🍃 MINT-1T: A one trillion token multimodal interleaved dataset.☆828Updated last year
- Everything about the SmolLM and SmolVLM family of models☆3,594Updated 3 weeks ago
- Minimalistic large language model 3D-parallelism training☆2,544Updated last month
- Official implementation of Half-Quadratic Quantization (HQQ)☆912Updated last month
- OLMoE: Open Mixture-of-Experts Language Models☆965Updated 4 months ago
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,180Updated 4 months ago
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆674Updated 9 months ago
- Recipes to scale inference-time compute of open models☆1,124Updated 8 months ago
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,654Updated last year
- Open weights language model from Google DeepMind, based on Griffin.☆663Updated this week
- Reaching LLaMA2 Performance with 0.1M Dollars☆987Updated last year
- [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices☆668Updated 8 months ago
- Codebase for Aria - an Open Multimodal Native MoE☆1,082Updated last year
- Serving multiple LoRA finetuned LLM as one☆1,140Updated last year
- YaRN: Efficient Context Window Extension of Large Language Models☆1,668Updated last year
- Code for BLT research paper☆2,027Updated 3 months ago
- A modern model graph visualizer and debugger☆1,384Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,291Updated 2 weeks ago
- Muon is Scalable for LLM Training☆1,426Updated 6 months ago
- Reference implementation of Megalodon 7B model☆529Updated 8 months ago
- PyTorch native quantization and sparsity for training and inference☆2,668Updated this week
- Official inference library for pre-processing of Mistral models☆854Updated this week
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,187Updated last year
- prime is a framework for efficient, globally distributed training of AI models over the internet.☆850Updated 2 months ago
- A pytorch quantization backend for optimum☆1,022Updated 2 months ago
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,407Updated last year
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆2,085Updated last year