lucidrains / tiny-recursive-modelLinks
Unofficial implementation of Tiny Recursive Model (TRM), improvement to HRM from Sapient AI, by Alexia Jolicoeur-Martineau
☆166Updated 2 weeks ago
Alternatives and similar repositories for tiny-recursive-model
Users that are interested in tiny-recursive-model are comparing it to the libraries listed below
Sorting:
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆121Updated last month
- Large multi-modal models (L3M) pre-training.☆224Updated 3 months ago
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆57Updated 7 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆109Updated 10 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last month
- ☆152Updated 3 months ago
- RLP: Reinforcement as a Pretraining Objective☆220Updated 3 months ago
- ☆27Updated last year
- open source alpha evolve☆68Updated 7 months ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆122Updated 2 months ago
- PyTorch implementation of models from the Zamba2 series.☆186Updated 11 months ago
- A collection of lightweight interpretability scripts to understand how LLMs think☆87Updated last week
- This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"☆284Updated last month
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 3 months ago
- Simple repository for training small reasoning models☆47Updated 11 months ago
- Collection of autoregressive model implementation☆85Updated 8 months ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆82Updated 7 months ago
- ☆106Updated 6 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 8 months ago
- DeMo: Decoupled Momentum Optimization☆198Updated last year
- σ-GPT: A New Approach to Autoregressive Models☆70Updated last year
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆149Updated 3 months ago
- OLMost every training recipe you need to perform data interventions with the OLMo family of models.☆63Updated this week
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆85Updated 3 months ago
- Exploration into the proposed architecture from Sapient Intelligence of Singapore 🇸🇬☆73Updated 4 months ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆132Updated 2 months ago
- ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"☆121Updated 6 months ago
- Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster☆71Updated 7 months ago
- Repository to create traveling waves integrate special information through time☆56Updated 5 months ago