facebookresearch / bltLinks
Code for BLT research paper
☆1,720Updated last month
Alternatives and similar repositories for blt
Users that are interested in blt are comparing it to the libraries listed below
Sorting:
- Minimalistic large language model 3D-parallelism training☆1,956Updated last week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,561Updated last month
- Training Large Language Model to Reason in a Continuous Latent Space☆1,165Updated 5 months ago
- Official PyTorch implementation for "Large Language Diffusion Models"☆2,435Updated 2 weeks ago
- Pretraining code for a large-scale depth-recurrent language model☆783Updated 3 weeks ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆883Updated 2 months ago
- Large Concept Models: Language modeling in a sentence representation space☆2,239Updated 5 months ago
- Recipes to scale inference-time compute of open models☆1,099Updated last month
- NanoGPT (124M) in 3 minutes☆2,751Updated 2 weeks ago
- Dream 7B, a large diffusion language model☆799Updated 2 weeks ago
- 🚀 Efficient implementations of state-of-the-art linear attention models in Torch and Triton☆2,845Updated this week
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,451Updated 2 months ago
- ☆1,025Updated 6 months ago
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆1,386Updated last month
- Understanding R1-Zero-Like Training: A Critical Perspective☆999Updated last week
- Muon is Scalable for LLM Training☆1,087Updated 3 months ago
- A bibliography and survey of the papers surrounding o1☆1,203Updated 7 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,670Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,788Updated last week
- Muon: An optimizer for hidden layers in neural networks☆971Updated last week
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,112Updated 5 months ago
- SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.☆783Updated 3 months ago
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch☆1,393Updated last month
- AllenAI's post-training codebase☆3,033Updated this week
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆712Updated last week
- A PyTorch native platform for training generative AI models☆3,977Updated this week
- Bringing BERT into modernity via both architecture changes and scaling☆1,426Updated this week
- nanoGPT style version of Llama 3.1☆1,389Updated 10 months ago
- Stanford NLP Python library for Representation Finetuning (ReFT)☆1,491Updated 4 months ago
- Simple RL training for reasoning☆3,650Updated 2 months ago