facebookresearch / bltLinks
Code for BLT research paper
β2,018Updated 2 months ago
Alternatives and similar repositories for blt
Users that are interested in blt are comparing it to the libraries listed below
Sorting:
- Large Concept Models: Language modeling in a sentence representation spaceβ2,317Updated 11 months ago
- A Self-adaptation Frameworkπ that adapts LLMs for unseen tasks in real-time!β1,179Updated 11 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modelingβ936Updated last month
- Training Large Language Model to Reason in a Continuous Latent Spaceβ1,430Updated 4 months ago
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorchβ1,829Updated 2 weeks ago
- Implementing DeepSeek R1's GRPO algorithm from scratchβ1,729Updated 8 months ago
- Pretraining and inference code for a large-scale depth-recurrent language modelβ857Updated last week
- Muon is an optimizer for hidden layers in neural networksβ2,154Updated last month
- Official PyTorch implementation for "Large Language Diffusion Models"β3,459Updated last month
- Minimalistic large language model 3D-parallelism trainingβ2,407Updated 3 weeks ago
- SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.β855Updated 2 months ago
- Recipes to scale inference-time compute of open modelsβ1,123Updated 7 months ago
- Dream 7B, a large diffusion language modelβ1,134Updated last month
- Minimalistic 4D-parallelism distributed training framework for education purposeβ1,939Updated 4 months ago
- NanoGPT (124M) in 3 minutesβ4,085Updated this week
- Bringing BERT into modernity via both architecture changes and scalingβ1,602Updated 6 months ago
- dLLM: Simple Diffusion Language Modelingβ1,541Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backendsβ2,233Updated this week
- Continuous Thought Machines, because thought takes time and reasoning is a process.β1,687Updated last week
- Everything about the SmolLM and SmolVLM family of modelsβ3,539Updated last month
- Muon is Scalable for LLM Trainingβ1,397Updated 5 months ago
- OLMoE: Open Mixture-of-Experts Language Modelsβ945Updated 3 months ago
- Stanford NLP Python library for Representation Finetuning (ReFT)β1,548Updated last week
- [ICLR2025 Spotlightπ₯] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parametersβ581Updated 10 months ago
- AllenAI's post-training codebaseβ3,515Updated this week
- 4M: Massively Multimodal Masked Modelingβ1,780Updated 7 months ago
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.β2,076Updated last year
- Scalable data pre processing and curation toolkit for LLMsβ1,327Updated this week
- Textbook on reinforcement learning from human feedbackβ1,382Updated last week
- H-Net: Hierarchical Network with Dynamic Chunkingβ800Updated last month