facebookresearch / bltLinks
Code for BLT research paper
β1,983Updated 3 months ago
Alternatives and similar repositories for blt
Users that are interested in blt are comparing it to the libraries listed below
Sorting:
- A Self-adaptation Frameworkπ that adapts LLMs for unseen tasks in real-time!β1,141Updated 7 months ago
- Large Concept Models: Language modeling in a sentence representation spaceβ2,280Updated 7 months ago
- Training Large Language Model to Reason in a Continuous Latent Spaceβ1,259Updated last month
- Pretraining and inference code for a large-scale depth-recurrent language modelβ826Updated last week
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modelingβ908Updated 4 months ago
- Implementing DeepSeek R1's GRPO algorithm from scratchβ1,561Updated 4 months ago
- Muon is an optimizer for hidden layers in neural networksβ1,710Updated 2 months ago
- NanoGPT (124M) in 3 minutesβ3,117Updated 2 months ago
- Official PyTorch implementation for "Large Language Diffusion Models"β2,864Updated last week
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorchβ1,455Updated 3 months ago
- Minimalistic large language model 3D-parallelism trainingβ2,191Updated 2 weeks ago
- SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.β822Updated last month
- Minimalistic 4D-parallelism distributed training framework for education purposeβ1,720Updated 3 weeks ago
- Recipes to scale inference-time compute of open modelsβ1,111Updated 3 months ago
- Dream 7B, a large diffusion language modelβ970Updated 3 weeks ago
- Bringing BERT into modernity via both architecture changes and scalingβ1,516Updated 2 months ago
- The simplest, fastest repository for training/finetuning small-sized VLMs.β4,026Updated last week
- Stanford NLP Python library for Representation Finetuning (ReFT)β1,512Updated 7 months ago
- nanoGPT style version of Llama 3.1β1,423Updated last year
- Continuous Thought Machines, because thought takes time and reasoning is a process.β1,294Updated 2 months ago
- Everything about the SmolLM and SmolVLM family of modelsβ3,211Updated last month
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backendsβ1,890Updated this week
- H-Net: Hierarchical Network with Dynamic Chunkingβ713Updated last month
- [ICLR2025 Spotlightπ₯] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parametersβ570Updated 7 months ago
- Sky-T1: Train your own O1 preview model within $450β3,327Updated 2 months ago
- Muon is Scalable for LLM Trainingβ1,302Updated last month
- procedural reasoning datasetsβ1,092Updated last week
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.β2,919Updated last month
- Textbook on reinforcement learning from human feedbackβ1,221Updated this week
- β1,034Updated 9 months ago