facebookresearch / lingua
Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
☆4,399Updated this week
Alternatives and similar repositories for lingua:
Users that are interested in lingua are comparing it to the libraries listed below
- A PyTorch native library for large model training☆3,091Updated this week
- NanoGPT (124M) in 3.4 minutes☆2,068Updated last week
- Efficient Triton Kernels for LLM Training☆4,183Updated this week
- PyTorch native post-training library☆4,703Updated this week
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,462Updated this week
- Official inference framework for 1-bit LLMs☆12,615Updated 3 weeks ago
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆4,147Updated last month
- nanoGPT style version of Llama 3.1☆1,290Updated 5 months ago
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆1,908Updated 5 months ago
- Everything about the SmolLM & SmolLM2 family of models☆1,554Updated last week
- Composable building blocks to build Llama Apps☆6,036Updated this week
- Large Concept Models: Language modeling in a sentence representation space☆1,713Updated this week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆5,749Updated last month
- PyTorch native quantization and sparsity for training and inference☆1,753Updated this week
- Agentic components of the Llama Stack APIs☆4,072Updated this week
- Code for BLT research paper☆1,314Updated this week
- Sky-T1: Train your own O1 preview model within $450☆1,795Updated this week
- Tools for merging pretrained large language models.☆5,113Updated last week
- ☆4,050Updated 7 months ago
- Video+code lecture on building nanoGPT from scratch☆3,782Updated 5 months ago
- ☆2,802Updated 4 months ago
- ☆2,180Updated last week
- SGLang is a fast serving framework for large language models and vision language models.☆7,353Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆11,197Updated this week
- A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.☆6,233Updated this week
- MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.☆1,217Updated last month
- Entropy Based Sampling and Parallel CoT Decoding☆3,197Updated 2 months ago
- ☆1,403Updated last week
- Implementation for MatMul-free LM.☆2,941Updated 2 months ago
- A course on aligning smol models.☆4,521Updated this week