π TPTT: Transforming Pretrained Transformers into Titans
β65Jun 7, 2026Updated 2 months ago
Alternatives and similar repositories for tptt
Users that are interested in tptt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Adaptation of titans-pytorch to llama models on HFβ24Mar 6, 2025Updated last year
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorchβ1,973Jul 13, 2026Updated 3 weeks ago
- A Reproduction of GDM's Nested Learning Paperβ707Feb 25, 2026Updated 5 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Schedulingβ43Dec 29, 2025Updated 7 months ago
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Ruleβ643Mar 13, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- β71Jul 8, 2025Updated last year
- β47Jun 16, 2025Updated last year
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Realityβ357May 20, 2026Updated 2 months ago
- β139Jun 6, 2025Updated last year
- β139Feb 4, 2026Updated 6 months ago
- π₯ A minimal training framework for scaling FLA modelsβ410Apr 22, 2026Updated 3 months ago
- Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/25β¦β26Dec 10, 2025Updated 8 months ago
- β17Sep 6, 2025Updated 11 months ago
- [COLM 2026] Resa: Transparent Reasoning Models via SAEsβ49Sep 23, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining itsβ¦β22Sep 10, 2024Updated last year
- An efficient implementation of the NSA (Native Sparse Attention) kernelβ134Jun 24, 2025Updated last year
- VibeRL is a Reinforcement Learning framework built essentially through vibe coding with Kimi K2.β17Aug 3, 2026Updated last week
- EvaByte: Efficient Byte-level Language Models at Scaleβ119Apr 22, 2025Updated last year
- Memory optimized Mixture of Expertsβ81Jul 25, 2025Updated last year
- β22Mar 26, 2026Updated 4 months ago
- continous batching and parallel acceleration for RWKV6β23Jun 28, 2024Updated 2 years ago
- Official JAX implementation of End-to-End Test-Time Training for Long Contextβ631Feb 15, 2026Updated 5 months ago
- Code for the forget-only version of the LSTM in the paper "The unreasonable effectiveness of the forget gate"β29May 16, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official implementation of the ΞBelief-RL method.β31Feb 28, 2026Updated 5 months ago
- Official codes for COLING 2024 paper "Robust and Scalable Model Editing for Large Language Models": https://arxiv.org/abs/2403.17431v1β14Mar 27, 2024Updated 2 years ago
- β29Jul 9, 2024Updated 2 years ago
- Noise Contrastive Test-Time Trainingβ13Mar 11, 2024Updated 2 years ago
- Scale digital agent rollouts without pain.β35Jun 18, 2026Updated last month
- Pretraining and inference code for a large-scale depth-recurrent language modelβ912Dec 29, 2025Updated 7 months ago
- Research work aimed at addressing the problem of modeling infinite-length contextβ52Dec 18, 2025Updated 7 months ago
- Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."β59Sep 25, 2025Updated 10 months ago
- Kwai Summary Attentionβ59May 8, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β20Feb 2, 2025Updated last year
- β285Jun 6, 2025Updated last year
- Simple & Scalable Pretraining for Neural Architecture Researchβ341Mar 31, 2026Updated 4 months ago
- Official repo of paper LM2β49Feb 13, 2025Updated last year
- AI Co-Scientist is a comprehensive multi-agent AI system designed for scientific research and hypothesis generation.β21Mar 4, 2025Updated last year
- Testing various improvements to Ranger21 for 2022β19Nov 6, 2024Updated last year
- RePo: Language Models with Context Re-Positioningβ83Mar 30, 2026Updated 4 months ago