Alternatives and similar repositories for titans-pytorch:

Users that are interested in titans-pytorch are comparing it to the libraries listed below

• lucidrains / native-sparse-attention-pytorch
  Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
  ☆593Updated 3 weeks ago
• facebookresearch / blt
  Code for BLT research paper
  ☆1,513Updated this week
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,040Updated 2 months ago
• test-time-training / ttt-lm-pytorch
  Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆1,177Updated 9 months ago
• ML-GSAI / LLaDA
  Official PyTorch implementation for "Large Language Diffusion Models"
  ☆1,492Updated 2 weeks ago
• fla-org / flash-linear-attention
  🚀 Efficient implementations of state-of-the-art linear attention models in Torch and Triton
  ☆2,287Updated this week
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,062Updated 2 months ago
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,022Updated 3 weeks ago
• BytedTsinghua-SIA / DAPO
  An Open-source RL System from ByteDance Seed and Tsinghua AIR
  ☆1,141Updated last week
• Haiyang-W / TokenFormer
  [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
  ☆548Updated 2 months ago
• KellerJordan / Muon
  Muon optimizer: +>30% sample efficiency with <3% wallclock overhead
  ☆575Updated 3 weeks ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆862Updated 2 months ago
• seal-rg / recurrent-pretraining
  Pretraining code for a large-scale depth-recurrent language model
  ☆743Updated last week
• jiachenzhu / DyT
  Code release for DynamicTanh (DyT)
  ☆885Updated 3 weeks ago
• hkust-nlp / simpleRL-reason
  Simple RL training for reasoning
  ☆3,472Updated last week
• HKUNLP / Dream
  Dream 7B, a large diffusion language model
  ☆551Updated last week
• kuleshov-group / bd3lms
  Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
  ☆536Updated last week
• tensorgi / T6
  The official implementation of Tensor ProducT ATTenTion Transformer (T6)
  ☆361Updated this week
• Open-Reasoner-Zero / Open-Reasoner-Zero
  Official Repo for Open-Reasoner-Zero
  ☆1,872Updated 2 weeks ago
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆863Updated last week
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,055Updated last month
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆716Updated last month
• alxndrTL / mamba.py
  A simple and efficient Mamba implementation in pure PyTorch and MLX.
  ☆1,207Updated 4 months ago
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆726Updated last week
• lucidrains / transfusion-pytorch
  Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
  ☆1,061Updated last month
• fla-org / native-sparse-attention
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆631Updated last month
• test-time-training / ttt-lm-jax
  Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆405Updated 8 months ago
• GAIR-NLP / LIMO
  LIMO: Less is More for Reasoning
  ☆913Updated 2 weeks ago
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,356Updated 8 months ago
• facebookresearch / schedule_free
  Schedule-Free Optimization in PyTorch
  ☆2,142Updated last week