facebookresearch / MobileLLMLinks
MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
☆1,300Updated last month
Alternatives and similar repositories for MobileLLM
Users that are interested in MobileLLM are comparing it to the libraries listed below
Sorting:
- nanoGPT style version of Llama 3.1☆1,373Updated 9 months ago
- Minimalistic large language model 3D-parallelism training☆1,888Updated last week
- DataComp for Language Models☆1,300Updated 2 months ago
- Official implementation of Half-Quadratic Quantization (HQQ)☆814Updated this week
- Everything about the SmolLM2 and SmolVLM family of models☆2,442Updated 2 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆874Updated last month
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,534Updated last year
- Muon is Scalable for LLM Training☆1,049Updated 2 months ago
- Recipes to scale inference-time compute of open models☆1,073Updated last week
- OLMoE: Open Mixture-of-Experts Language Models☆764Updated 2 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,563Updated last week
- Fast, Flexible and Portable Structured Generation☆980Updated last week
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆2,005Updated 10 months ago
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,035Updated this week
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆1,417Updated this week
- Reaching LLaMA2 Performance with 0.1M Dollars☆979Updated 10 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,390Updated this week
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection☆1,560Updated 7 months ago
- Democratizing Reinforcement Learning for LLMs☆3,291Updated 2 weeks ago
- Code for BLT research paper☆1,664Updated last week
- LIMO: Less is More for Reasoning☆944Updated last month
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,372Updated last month
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆637Updated last month
- PyTorch native quantization and sparsity for training and inference☆2,064Updated this week
- Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.☆1,266Updated last week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,505Updated 2 months ago
- PyTorch native post-training library☆5,217Updated this week
- NanoGPT (124M) in 3 minutes☆2,600Updated this week
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,249Updated 2 months ago
- Training Large Language Model to Reason in a Continuous Latent Space☆1,120Updated 4 months ago