VsonicV / es-fine-tuning-paperLinks
This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"
☆114Updated this week
Alternatives and similar repositories for es-fine-tuning-paper
Users that are interested in es-fine-tuning-paper are comparing it to the libraries listed below
Sorting:
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 8 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆109Updated 5 months ago
- ☆114Updated last month
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆184Updated 7 months ago
- Official repo of paper LM2☆45Updated 7 months ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆99Updated 2 months ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆112Updated 2 months ago
- ☆123Updated 7 months ago
- RLP: Reinforcement as a Pretraining Objective☆69Updated last week
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆147Updated last week
- ☆142Updated last month
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆230Updated 2 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆77Updated 6 months ago
- Official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)☆51Updated this week
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 8 months ago
- Train your own SOTA deductive reasoning model☆107Updated 7 months ago
- 📄Small Batch Size Training for Language Models☆62Updated last week
- Open source interpretability artefacts for R1.☆160Updated 5 months ago
- ☆124Updated 9 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆164Updated 3 months ago
- ☆86Updated last week
- PyTorch implementation of models from the Zamba2 series.☆185Updated 8 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆102Updated 5 months ago
- ☆102Updated 2 months ago
- DeMo: Decoupled Momentum Optimization☆193Updated 10 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated 10 months ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆129Updated last year
- ☆85Updated last year
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆193Updated last year
- Storing long contexts in tiny caches with self-study☆194Updated 3 weeks ago