☆73Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for looped_transformer
Users that are interested in looped_transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…☆50Apr 8, 2023Updated 3 years ago
- Code for "On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding (ICML 2025)"☆10Jun 29, 2025Updated last year
- Code for Looped Transformers for Length Generalization (https://arxiv.org/abs/2409.15647), ICLR 2025☆14Apr 30, 2025Updated last year
- Generative Equilibrium Transformer☆31Nov 11, 2023Updated 2 years ago
- Official repository for "Emergence and Evolution of Interpretable Concepts in Diffusion Models"☆13Oct 22, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A replication of "Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA" by Bae et al.☆14Aug 26, 2025Updated last year
- ☆20Oct 25, 2022Updated 4 years ago
- ☆48Sep 9, 2026Updated last month
- ☆23Oct 18, 2026Updated last week
- LoopFormer is an elastic-depth looped Transformer trained on variable-length trajectories, using time/step-size conditioning and a shortc…☆54Mar 28, 2026Updated 6 months ago
- Combining SOAP and MUON☆24Feb 11, 2025Updated last year
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆20Nov 19, 2024Updated last year
- Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence☆71Nov 11, 2025Updated 11 months ago
- Minimal and highly hackable implementation of Looped Transformers with GPT☆25Mar 8, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆68May 18, 2023Updated 3 years ago
- Mutual information estimators and benchmarks☆14Oct 6, 2026Updated 2 weeks ago
- [ICML 2025] Unlearning in Diffusion Models using Sparse Autoencoders☆65Oct 16, 2025Updated last year
- Learning ReLU INRs with B-spline wavelets.☆14Jun 5, 2024Updated 2 years ago
- Code accompanying the paper "A contrastive rule for meta-learning"☆13Oct 31, 2024Updated last year
- (Nanochat based) Full-bandwidth transformer, feed LLM's own deep hidden states back to itself☆16Oct 3, 2026Updated 3 weeks ago
- Gecko Architecture☆19Jan 13, 2026Updated 9 months ago
- ☆93Aug 18, 2024Updated 2 years ago
- An approximate implementation of the OpenAI paper - An Empirical Model of Large-Batch Training for MNIST☆11Nov 19, 2022Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆14Sep 18, 2024Updated 2 years ago
- ☆45Apr 30, 2018Updated 8 years ago
- Efficient PScan implementation in PyTorch☆17Jan 2, 2024Updated 2 years ago
- Pytorch code for experiments on Linear Transformers☆24Jan 12, 2024Updated 2 years ago
- Supervised Training of Conditional Monge Maps☆20Oct 30, 2023Updated 2 years ago
- ☆23Mar 1, 2023Updated 3 years ago
- Pretraining and inference code for a large-scale depth-recurrent language model☆984Dec 29, 2025Updated 9 months ago
- Official repo of paper LM2☆49Feb 13, 2025Updated last year
- 中国人民大学 YOJ 题库☆16Jun 9, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated 2 years ago
- MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation☆18Sep 2, 2024Updated 2 years ago
- ☆14Feb 27, 2026Updated 7 months ago
- ☆13Jun 26, 2024Updated 2 years ago
- Official Code Repository for the paper "Key-value memory in the brain"☆34Feb 25, 2025Updated last year
- [NeurIPS 2025] Official Pytorch Implementation of "The Curse of Depth in Large Language Models" by Wenfang Sun, Xinyuan Song, Pengxiang L…☆74Mar 3, 2026Updated 7 months ago
- Speedrunning PLM pretraining☆14Sep 22, 2026Updated last month