facebookresearch / MobileLLMLinks
MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
☆1,374Updated 5 months ago
Alternatives and similar repositories for MobileLLM
Users that are interested in MobileLLM are comparing it to the libraries listed below
Sorting:
- nanoGPT style version of Llama 3.1☆1,427Updated last year
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆915Updated 5 months ago
- Everything about the SmolLM and SmolVLM family of models☆3,286Updated 3 weeks ago
- DataComp for Language Models☆1,367Updated 3 weeks ago
- Minimalistic large language model 3D-parallelism training☆2,246Updated last month
- TinyChatEngine: On-Device LLM Inference Library☆897Updated last year
- MINT-1T: A one trillion token multimodal interleaved dataset.☆825Updated last year
- OLMoE: Open Mixture-of-Experts Language Models☆875Updated 2 weeks ago
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,133Updated last week
- Official implementation of Half-Quadratic Quantization (HQQ)☆879Updated last month
- Recipes to scale inference-time compute of open models☆1,108Updated 4 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆985Updated last year
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,605Updated last year
- Reference implementation of Megalodon 7B model☆522Updated 4 months ago
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆658Updated 5 months ago
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆2,060Updated last year
- Open weights language model from Google DeepMind, based on Griffin.☆651Updated 4 months ago
- A pytorch quantization backend for optimum☆989Updated last month
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,973Updated last week
- PyTorch native quantization and sparsity for training and inference☆2,384Updated last week
- Code for BLT research paper☆1,987Updated 4 months ago
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆2,042Updated this week
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,596Updated 5 months ago
- [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration☆3,282Updated 2 months ago
- AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:☆2,253Updated 4 months ago
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,281Updated 7 months ago
- Bringing BERT into modernity via both architecture changes and scaling☆1,529Updated 3 months ago
- A modern model graph visualizer and debugger☆1,318Updated last week
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,854Updated last year
- NanoGPT (124M) in 3 minutes☆3,165Updated 2 months ago