facebookresearch / MobileLLMLinks
MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
☆1,329Updated 4 months ago
Alternatives and similar repositories for MobileLLM
Users that are interested in MobileLLM are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆908Updated 4 months ago
- DataComp for Language Models☆1,367Updated last week
- nanoGPT style version of Llama 3.1☆1,423Updated last year
- MINT-1T: A one trillion token multimodal interleaved dataset.☆825Updated last year
- Everything about the SmolLM and SmolVLM family of models☆3,211Updated last month
- Minimalistic large language model 3D-parallelism training☆2,191Updated 2 weeks ago
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,589Updated last year
- Reaching LLaMA2 Performance with 0.1M Dollars☆987Updated last year
- Official implementation of Half-Quadratic Quantization (HQQ)☆878Updated last week
- OLMoE: Open Mixture-of-Experts Language Models☆863Updated 6 months ago
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆655Updated 4 months ago
- TinyChatEngine: On-Device LLM Inference Library☆894Updated last year
- Open weights language model from Google DeepMind, based on Griffin.☆650Updated 3 months ago
- Recipes to scale inference-time compute of open models☆1,111Updated 3 months ago
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆2,053Updated last year
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,400Updated last year
- YaRN: Efficient Context Window Extension of Large Language Models☆1,606Updated last year
- Reference implementation of Megalodon 7B model☆522Updated 4 months ago
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection☆1,603Updated 10 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,890Updated this week
- [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices☆660Updated 4 months ago
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,124Updated last month
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,852Updated last year
- Training LLMs with QLoRA + FSDP☆1,527Updated 10 months ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆988Updated 4 months ago
- Stanford NLP Python library for Representation Finetuning (ReFT)☆1,512Updated 7 months ago
- Official inference library for pre-processing of Mistral models☆790Updated 2 weeks ago
- PyTorch native quantization and sparsity for training and inference☆2,341Updated this week
- TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones☆1,298Updated last year
- Code for BLT research paper☆1,983Updated 3 months ago