facebookresearch / blt
Code for BLT research paper
β1,439Updated this week
Alternatives and similar repositories for blt:
Users that are interested in blt are comparing it to the libraries listed below
- Official PyTorch implementation for "Large Language Diffusion Models"β1,350Updated 3 weeks ago
- A Self-adaptation Frameworkπ that adapts LLMs for unseen tasks in real-time!β1,020Updated 2 months ago
- Training Large Language Model to Reason in a Continuous Latent Spaceβ1,015Updated 2 months ago
- Pretraining code for a large-scale depth-recurrent language modelβ709Updated 3 weeks ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modelingβ857Updated last month
- Recipes to scale inference-time compute of open modelsβ1,048Updated last month
- Minimalistic 4D-parallelism distributed training framework for education purposeβ970Updated 3 weeks ago
- A bibliography and survey of the papers surrounding o1β1,183Updated 4 months ago
- An Open-source RL System from ByteDance Seed and Tsinghua AIRβ915Updated last week
- Large Concept Models: Language modeling in a sentence representation spaceβ2,077Updated 2 months ago
- Minimalistic large language model 3D-parallelism trainingβ1,737Updated this week
- Muon is Scalable for LLM Trainingβ993Updated last week
- [ICLR2025 Spotlightπ₯] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parametersβ541Updated last month
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorchβ1,259Updated 3 weeks ago
- OLMoE: Open Mixture-of-Experts Language Modelsβ698Updated 3 weeks ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backendsβ1,358Updated last week
- Muon optimizer: +>30% sample efficiency with <3% wallclock overheadβ539Updated last week
- π Efficient implementations of state-of-the-art linear attention models in Torch and Tritonβ2,195Updated this week
- LIMO: Less is More for Reasoningβ875Updated last month
- A PyTorch native library for large model trainingβ3,506Updated last week
- AllenAI's post-training codebaseβ2,854Updated this week
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projectionβ1,531Updated 5 months ago
- SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.β721Updated 2 weeks ago
- β1,011Updated 3 months ago
- Stanford NLP Python library for Representation Finetuning (ReFT)β1,454Updated last month
- Understanding R1-Zero-Like Training: A Critical Perspectiveβ725Updated this week
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelsβ439Updated last week
- Bringing BERT into modernity via both architecture changes and scalingβ1,302Updated last week
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.β1,968Updated 8 months ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptationβ753Updated 6 months ago