lucidrains / titans-pytorchLinks
Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch
β1,368Updated this week
Alternatives and similar repositories for titans-pytorch
Users that are interested in titans-pytorch are comparing it to the libraries listed below
Sorting:
- Code for BLT research paperβ1,675Updated 2 weeks ago
- A Self-adaptation Frameworkπ that adapts LLMs for unseen tasks in real-time!β1,066Updated 4 months ago
- Official PyTorch implementation for "Large Language Diffusion Models"β2,036Updated last week
- Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paperβ637Updated 3 weeks ago
- Muon: An optimizer for hidden layers in neural networksβ678Updated last week
- [ICLR2025 Spotlightπ₯] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parametersβ559Updated 3 months ago
- Pretraining code for a large-scale depth-recurrent language modelβ770Updated last week
- Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden Statesβ1,201Updated 10 months ago
- Continuous Thought Machines, because thought takes time and reasoning is a process.β958Updated last week
- π Efficient implementations of state-of-the-art linear attention models in Torch and Tritonβ2,453Updated this week
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modelingβ876Updated last month
- Dream 7B, a large diffusion language modelβ703Updated last month
- Code release for DynamicTanh (DyT)β940Updated 2 months ago
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelsβ660Updated last month
- Training Large Language Model to Reason in a Continuous Latent Spaceβ1,135Updated 4 months ago
- Muon is Scalable for LLM Trainingβ1,052Updated 2 months ago
- Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden Statesβ411Updated 9 months ago
- MMaDA - Open-Sourced Multimodal Large Diffusion Language Modelsβ934Updated this week
- An Open-source RL System from ByteDance Seed and Tsinghua AIRβ1,284Updated 3 weeks ago
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAIβ1,133Updated 3 weeks ago
- TTRL: Test-Time Reinforcement Learningβ570Updated 2 weeks ago
- Recipes to scale inference-time compute of open modelsβ1,087Updated 2 weeks ago
- NanoGPT (124M) in 3 minutesβ2,610Updated last week
- A suite of image and video neural tokenizersβ1,632Updated 3 months ago
- Simple RL training for reasoningβ3,601Updated last month
- Large Concept Models: Language modeling in a sentence representation spaceβ2,215Updated 4 months ago
- Implementing DeepSeek R1's GRPO algorithm from scratchβ1,390Updated last month
- Understanding R1-Zero-Like Training: A Critical Perspectiveβ956Updated last week
- A simple and efficient Mamba implementation in pure PyTorch and MLX.β1,242Updated 6 months ago
- State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!β1,189Updated last week