lucidrains / mind-evolutionLinks
Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
☆53Updated 3 weeks ago
Alternatives and similar repositories for mind-evolution
Users that are interested in mind-evolution are comparing it to the libraries listed below
Sorting:
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆78Updated last month
- Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise☆36Updated 9 months ago
- ☆79Updated 10 months ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆127Updated 10 months ago
- Focused on fast experimentation and simplicity☆74Updated 6 months ago
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆46Updated 3 months ago
- open source alpha evolve☆64Updated last month
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆103Updated 2 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 5 months ago
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆37Updated 4 months ago
- Exploration into the Firefly algorithm in Pytorch☆40Updated 4 months ago
- ☆16Updated 3 months ago
- A Qwen .5B reasoning model trained on OpenR1-Math-220k☆14Updated 3 months ago
- ☆56Updated 3 months ago
- Simple repository for training small reasoning models☆33Updated 4 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆52Updated 3 months ago
- A repository for research on medium sized language models.☆76Updated last year
- RWKV-7: Surpassing GPT☆91Updated 7 months ago
- Implementation of Infini-Transformer in Pytorch☆111Updated 5 months ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated last month
- Esoteric Language Models☆77Updated last week
- Official repo of paper LM2☆41Updated 4 months ago
- ☆88Updated last week
- Collection of autoregressive model implementation☆85Updated 2 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆101Updated 6 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆101Updated 3 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆102Updated 2 months ago
- ☆52Updated last year
- Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster☆70Updated last month