lucidrains / HRMLinks
Exploration into the proposed architecture from Sapient Intelligence of Singapore πΈπ¬
β73Updated 5 months ago
Alternatives and similar repositories for HRM
Users that are interested in HRM are comparing it to the libraries listed below
Sorting:
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.β41Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokensβ150Updated 2 weeks ago
- β109Updated 5 months ago
- PyTorch implementation of models from the Zamba2 series.β186Updated 11 months ago
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.β345Updated last year
- Simple GRPO scripts and configurations.β59Updated 11 months ago
- β133Updated last year
- Train your own SOTA deductive reasoning modelβ107Updated 10 months ago
- Code for ExploreTomβ89Updated 6 months ago
- look how they massacred my boyβ63Updated last year
- β137Updated last year
- EvaByte: Efficient Byte-level Language Models at Scaleβ114Updated 9 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)β109Updated 10 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.β175Updated last year
- GRadient-INformed MoEβ264Updated last year
- smolLM with Entropix sampler on pytorchβ149Updated last year
- Alice in Wonderland code base for experiments and raw experiments dataβ131Updated 4 months ago
- β105Updated last year
- β40Updated last year
- DeMo: Decoupled Momentum Optimizationβ198Updated last year
- RWKV-7: Surpassing GPTβ103Updated last year
- Video+code lecture on building nanoGPT from scratchβ68Updated last year
- Lightweight toolkit package to train and fine-tune 1.58bit Language modelsβ107Updated 8 months ago
- Implementation of mamba with rustβ90Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyersβ73Updated 8 months ago
- β82Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"β103Updated last year
- This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"β285Updated last month
- Memoria is a human-inspired memory architecture for neural networks.β82Updated last year
- β62Updated 6 months ago