lucidrains / tiny-recursive-modelLinks
Unofficial implementation of Tiny Recursive Model (TRM), improvement to HRM from Sapient AI, by Alexia Jolicoeur-Martineau
☆174Updated last month
Alternatives and similar repositories for tiny-recursive-model
Users that are interested in tiny-recursive-model are comparing it to the libraries listed below
Sorting:
- open source alpha evolve☆69Updated 8 months ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆130Updated 2 months ago
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆59Updated 8 months ago
- ☆171Updated last week
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆110Updated 11 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated last year
- Extending the Context of Pretrained LLMs by Dropping Their Positional Embedding☆200Updated 3 weeks ago
- PyTorch implementation of models from the Zamba2 series.☆186Updated last year
- ☆82Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆128Updated 4 months ago
- [ICLR 2026] Official PyTorch Implementation of RLP: Reinforcement as a Pretraining Objective☆231Updated 2 weeks ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆86Updated 4 months ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆105Updated last year
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆144Updated 2 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆61Updated last year
- DeMo: Decoupled Momentum Optimization☆198Updated last year
- ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"☆126Updated last week
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆150Updated 4 months ago
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆84Updated 2 months ago
- Implementation of various evolutionary algorithms, starting with evolutionary strategies☆43Updated last week
- Large multi-modal models (L3M) pre-training.☆229Updated 4 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 4 months ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆84Updated 8 months ago
- Jax Codebase for Evolutionary Strategies at the Hyperscale☆218Updated last month
- ☆56Updated last year
- Collection of autoregressive model implementation☆85Updated 3 weeks ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆135Updated 3 months ago
- Train, tune, and infer Bamba model☆137Updated 8 months ago
- Official Implementation of Dynamic erf (Derf).☆127Updated last month
- ☆27Updated last year