facebookresearch / MobileLLM
MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
☆1,155Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for MobileLLM
- nanoGPT style version of Llama 3.1☆1,246Updated 3 months ago
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆803Updated 3 months ago
- MINT-1T: A one trillion token multimodal interleaved dataset.☆774Updated 3 months ago
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆2,571Updated last week
- Official implementation of Half-Quadratic Quantization (HQQ)☆701Updated last week
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,336Updated 7 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆960Updated 3 months ago
- ReFT: Representation Finetuning for Language Models☆1,159Updated 2 weeks ago
- Minimalistic large language model 3D-parallelism training☆1,260Updated this week
- ☆448Updated 7 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,045Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆811Updated this week
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆523Updated this week
- Janus-Series: Unified Multimodal Understanding and Generation Models☆1,084Updated last week
- TinyChatEngine: On-Device LLM Inference Library☆747Updated 4 months ago
- DataComp for Language Models☆1,157Updated this week
- ☆641Updated this week
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆685Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,634Updated this week
- OLMoE: Open Mixture-of-Experts Language Models☆460Updated this week
- PyTorch native quantization and sparsity for training and inference☆1,585Updated this week
- [NeurIPS'24 Spotlight] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces in…☆791Updated this week
- Open weights language model from Google DeepMind, based on Griffin.☆607Updated 4 months ago
- NanoGPT (124M) quality in 7.8 8xH100-minutes☆1,033Updated this week
- LLM Analytics☆615Updated last month
- Codebase for Aria - an Open Multimodal Native MoE☆832Updated this week
- ☆2,746Updated 2 months ago
- TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones☆1,251Updated 7 months ago
- Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".☆781Updated 3 weeks ago