Evolution Pretraining Fully in Int Formats
☆189Feb 25, 2026Updated 8 months ago
Alternatives and similar repositories for nano-egg
Users that are interested in nano-egg are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Jax Codebase for Evolutionary Strategies at the Hyperscale☆385Feb 27, 2026Updated 8 months ago
- Official implementation for "How Should We Meta-Learn Reinforcement Learning Algorithms?"☆23Sep 7, 2025Updated last year
- This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"☆393Jun 26, 2026Updated 4 months ago
- Implementation and explorations into PopuLoRA, Co-Evolving LLM Populations for Reasoning Self-Play☆19Oct 17, 2026Updated 3 weeks ago
- Official code for the transformer LLM experiments in the paper [Evolution Strategies at the Hyperscale](https://arxiv.org/abs/2511.16652)…☆16Apr 14, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Neuroevolution Community☆17Nov 17, 2025Updated 11 months ago
- ☆14Aug 30, 2025Updated last year
- Population Based Training of Petri Dish Neural Cellular Automata☆19Apr 14, 2026Updated 6 months ago
- Evolutionary strategies finetuning library for LLMs☆26Sep 12, 2026Updated last month
- Official implementation of DiscoGen, for "Procedural Generation of Algorithm Discovery Tasks in Machine Learning"☆51Sep 16, 2026Updated last month
- A simple, performant and scalable JAX-based world modeling codebase.☆165Jan 15, 2026Updated 9 months ago
- Official Codebase: LT2: Linear-Time Looped Transformers.☆68Jul 27, 2026Updated 3 months ago
- Speedrun for pretraining without backpropagation☆450Updated this week
- A collection of lightweight interpretability scripts to understand how LLMs think☆92Mar 18, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Internal Coherence Maximization (ICM): A Label-Free, Unsupervised Training Framework for LLMs☆28Sep 5, 2025Updated last year
- Generic building-block toolbox for training neural networks with adaptive and recursive execution. It provides reusable components to con…☆27Jun 29, 2026Updated 4 months ago
- [ICML 2026] NITP: Next Implicit Token Prediction for LLM Pre-training☆36May 26, 2026Updated 5 months ago
- Code, results and checkpoints for the paper "Silent Pipeline Defects in World-Model RL: A Dreamer 4 Case Study": a PyTorch reimplementati…☆40Oct 25, 2026Updated 2 weeks ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆18Apr 30, 2025Updated last year
- "Explaining Attention with Program Synthesis" | Work to reproduce analyzing and replacing attention heads from MIT LINGO '25 Summer Resea…☆23Updated this week
- smolLM with Entropix sampler on pytorch☆148Oct 31, 2024Updated 2 years ago
- nanoGPT using Equinox☆15Mar 3, 2023Updated 3 years ago
- explore token trajectory trees on instruct and base models☆159May 29, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- PyTorch Code for Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation☆253Sep 30, 2026Updated last month
- An imaginary extension of rotary position embeddings for long-context language models☆35Dec 9, 2025Updated 10 months ago
- LOQA: Learning with Opponent Q-learning Awareness (ICLR-2024)☆10Sep 28, 2024Updated 2 years ago
- GCRL in JAX. Official repository for LEO (ICML 2026).☆35Jun 20, 2026Updated 4 months ago
- Fast reinforcement learning 💨☆29Jul 15, 2025Updated last year
- Official JAX implementation of End-to-End Test-Time Training for Long Context☆717Feb 15, 2026Updated 8 months ago
- Global CoT Analysis: Initial attempts to uncover patterns across many chains of thought☆20Feb 10, 2026Updated 8 months ago
- Marketplace ML experiment - training without backprop☆28Sep 9, 2025Updated last year
- Residual Quantization Autoencoder, used for interpreting LLMs☆14Jan 1, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official implementation of the paper "Next Embedding Prediction Makes World Models Stronger"☆41Aug 24, 2026Updated 2 months ago
- Softened ROSA QKV Operators for Training Next-Generation LLM Models☆39Sep 13, 2026Updated last month
- PyTorch Code for Energy-Based Transformers paper -- generalizable reasoning and scalable learning☆665Apr 21, 2026Updated 6 months ago
- Linear Attention for Efficient Bidirectional Sequence Modeling☆18May 13, 2025Updated last year
- PyTorch World Model implementation with PPO.☆13Jan 6, 2020Updated 6 years ago
- Code for the paper "Hypercube-based Retrieval-Augmented Generation on Scientific Question-Answering".☆10Jun 10, 2026Updated 4 months ago
- Functional JAX middleware using a compute Node abstraction☆22Sep 6, 2026Updated 2 months ago