facebookresearch / lingua
Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
☆4,481Updated last month
Alternatives and similar repositories for lingua:
Users that are interested in lingua are comparing it to the libraries listed below
- NanoGPT (124M) in 3 minutes☆2,403Updated this week
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,530Updated this week
- Large Concept Models: Language modeling in a sentence representation space☆2,053Updated last month
- Sky-T1: Train your own O1 preview model within $450☆3,142Updated last week
- A PyTorch native library for large model training☆3,470Updated this week
- Official inference framework for 1-bit LLMs☆12,814Updated last month
- nanoGPT style version of Llama 3.1☆1,341Updated 7 months ago
- Everything about the SmolLM2 and SmolVLM family of models☆2,035Updated last week
- Code for BLT research paper☆1,436Updated this week
- Schedule-Free Optimization in PyTorch☆2,116Updated 3 weeks ago
- PyTorch native post-training library☆5,014Updated this week
- Training Large Language Model to Reason in a Continuous Latent Space☆985Updated last month
- Minimalistic 4D-parallelism distributed training framework for education purpose☆948Updated 2 weeks ago
- Official repository for our work on micro-budget training of large-scale diffusion models.☆1,356Updated 2 months ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,002Updated last month
- Minimalistic large language model 3D-parallelism training☆1,701Updated this week
- Curated list of datasets and tools for post-training.☆2,844Updated last month
- PyTorch native quantization and sparsity for training and inference☆1,913Updated this week
- ☆2,889Updated 6 months ago
- Recipes to scale inference-time compute of open models☆1,041Updated 3 weeks ago
- DataComp for Language Models☆1,263Updated this week
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆1,316Updated last week
- verl: Volcano Engine Reinforcement Learning for LLMs☆5,399Updated this week
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆1,952Updated 7 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,568Updated this week
- The n-gram Language Model☆1,402Updated 7 months ago
- Efficient Triton Kernels for LLM Training☆4,683Updated this week