Official Codebase: LT2: Linear-Time Looped Transformers.
☆69Jul 27, 2026Updated 3 months ago
Alternatives and similar repositories for LT2
Users that are interested in LT2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11May 14, 2026Updated 5 months ago
- [ICML 2026] Spherical Steering: Geometry-Aware Activation Rotation for Language Models☆24May 19, 2026Updated 5 months ago
- [ICML 2026] NITP: Next Implicit Token Prediction for LLM Pre-training☆36May 26, 2026Updated 5 months ago
- Linear Attention Architectures: Mechanisms, Trade-offs, and Cross-Layer Routing (Technical Report)☆40Jul 10, 2026Updated 4 months ago
- Pipelined Self-Speculative Decoding for Looped Transformer☆24Sep 24, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICML 2026] Code for Equilibrium Reasoners: learning attractor dynamics for scalable reasoning☆61Sep 14, 2026Updated last month
- ☆32May 20, 2026Updated 5 months ago
- Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models☆16May 11, 2026Updated 6 months ago
- A curated list of papers and selected technical blogs on Loop Models.☆480Updated this week
- ☆93Aug 19, 2026Updated 2 months ago
- The best ChatGPT that $100 can buy.☆61Oct 27, 2026Updated 2 weeks ago
- Code for "On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding (ICML 2025)"☆10Jun 29, 2025Updated last year
- ☆49Sep 9, 2026Updated 2 months ago
- (Nanochat based) Full-bandwidth transformer, feed LLM's own deep hidden states back to itself☆20Oct 3, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Grouped Query Experts☆12Sep 21, 2026Updated last month
- [NeurIPS 2025] Official Pytorch Implementation of "The Curse of Depth in Large Language Models" by Wenfang Sun, Xinyuan Song, Pengxiang L…☆75Mar 3, 2026Updated 8 months ago
- ☆13Jan 5, 2026Updated 10 months ago
- Code for Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformers (https://arxiv.org/abs/2606.31779)☆55Jul 20, 2026Updated 3 months ago
- Official Repo for Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics☆80Sep 25, 2026Updated last month
- [Tech Report, NeurIPS 2026] Expanded Hyper-Connections☆77Updated this week
- ☆13Aug 31, 2026Updated 2 months ago
- Code for "Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation"☆19Sep 1, 2026Updated 2 months ago
- [ACL 2026] Official repo for "Native Hybrid Attention for Efficient Sequence Modeling"☆36Sep 17, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for DASH, a faster alternative to Distributed Shampoo via block stacking.☆13Feb 18, 2026Updated 8 months ago
- The official implementation of HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization☆19Mar 7, 2025Updated last year
- Official repository for Parallax (Parameterized Local Linear Attention)☆71Jul 30, 2026Updated 3 months ago
- Triton kernels for dynamic causal short convolutions.☆35Jun 4, 2026Updated 5 months ago
- ☆289Jun 6, 2025Updated last year
- Cuda kernels for leveraging LLM sparsity to improve throughput and decrease the memory requirements during inference and training.☆263Jun 29, 2026Updated 4 months ago
- Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence☆72Nov 11, 2025Updated last year
- Code with CliqueFlowmer model for Optimal Computational Materials Discovery☆17Nov 2, 2026Updated last week
- ☆40Feb 26, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- FlashLoop: Fast and Memory-Efficient Looped Transformers via Lazy Updates☆26Sep 28, 2026Updated last month
- The Newton-Muon optimizer☆35Jun 5, 2026Updated 5 months ago
- high-performance linear attention kernel library built on TileLang☆753Oct 30, 2026Updated last week
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated last year
- Code for MatGPTQ: Efficient and Accurate Inference over Nested Quantized Models☆35Oct 6, 2026Updated last month
- Compositional Muon release☆25Jun 5, 2026Updated 5 months ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆18Apr 30, 2025Updated last year
Are these results useful?