lucidrains / tiny-recursive-modelLinks
Unofficial implementation of Tiny Recursive Model (TRM), improvement to HRM from Sapient AI, by Alexia Jolicoeur-Martineau
☆152Updated this week
Alternatives and similar repositories for tiny-recursive-model
Users that are interested in tiny-recursive-model are comparing it to the libraries listed below
Sorting:
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆118Updated 3 weeks ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated 11 months ago
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆57Updated 6 months ago
- open source alpha evolve☆66Updated 6 months ago
- ☆139Updated 2 months ago
- ☆82Updated last year
- ☆58Updated 3 weeks ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆105Updated last year
- Large multi-modal models (L3M) pre-training.☆222Updated 2 months ago
- Flash Attention Triton kernel with support for second-order derivatives☆117Updated last month
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- RLP: Reinforcement as a Pretraining Objective☆210Updated 2 months ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆132Updated last month
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆108Updated 9 months ago
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 10 months ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆85Updated 3 months ago
- Train, tune, and infer Bamba model☆137Updated 6 months ago
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆78Updated 2 weeks ago
- ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"☆117Updated 5 months ago
- Simple repository for training small reasoning models☆47Updated 10 months ago
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆38Updated 9 months ago
- ☆28Updated last year
- Exploration into the Firefly algorithm in Pytorch☆41Updated 10 months ago
- σ-GPT: A New Approach to Autoregressive Models☆70Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆120Updated 2 months ago
- Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster☆71Updated 6 months ago
- A byte-level decoder architecture that matches the performance of tokenized Transformers.☆66Updated last year
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆91Updated last year
- ☆56Updated last year