facebookresearch / bltLinks
Code for BLT research paper
☆2,006Updated last week
Alternatives and similar repositories for blt
Users that are interested in blt are comparing it to the libraries listed below
Sorting:
- Large Concept Models: Language modeling in a sentence representation space☆2,302Updated 9 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆926Updated last week
- Training Large Language Model to Reason in a Continuous Latent Space☆1,327Updated 3 months ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,162Updated 9 months ago
- Official PyTorch implementation for "Large Language Diffusion Models"☆3,210Updated this week
- Pretraining and inference code for a large-scale depth-recurrent language model☆843Updated 3 weeks ago
- Muon is an optimizer for hidden layers in neural networks☆1,983Updated 4 months ago
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,662Updated 6 months ago
- SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.☆833Updated last month
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch☆1,486Updated last month
- Recipes to scale inference-time compute of open models☆1,117Updated 5 months ago
- Minimalistic large language model 3D-parallelism training☆2,311Updated 2 months ago
- Dream 7B, a large diffusion language model☆1,054Updated last month
- Bringing BERT into modernity via both architecture changes and scaling☆1,559Updated 4 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,890Updated 2 months ago
- Muon is Scalable for LLM Training☆1,354Updated 3 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,078Updated last week
- Continuous Thought Machines, because thought takes time and reasoning is a process.☆1,396Updated 3 weeks ago
- Everything about the SmolLM and SmolVLM family of models☆3,369Updated last month
- NanoGPT (124M) in 3 minutes☆3,785Updated last week
- OLMoE: Open Mixture-of-Experts Language Models☆899Updated last month
- [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters☆576Updated 9 months ago
- H-Net: Hierarchical Network with Dynamic Chunking☆769Updated last month
- AllenAI's post-training codebase☆3,284Updated this week
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,214Updated last month
- [ICLR 2025 Oral] Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆884Updated 4 months ago
- Sky-T1: Train your own O1 preview model within $450☆3,352Updated 4 months ago
- Textbook on reinforcement learning from human feedback☆1,295Updated this week
- Official repository for our work on micro-budget training of large-scale diffusion models.☆1,521Updated 10 months ago
- ☆1,035Updated 10 months ago