VsonicV / es-fine-tuning-paperLinks
This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"
☆255Updated this week
Alternatives and similar repositories for es-fine-tuning-paper
Users that are interested in es-fine-tuning-paper are comparing it to the libraries listed below
Sorting:
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆111Updated last month
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 10 months ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆119Updated 3 weeks ago
- ☆155Updated 3 months ago
- RLP: Reinforcement as a Pretraining Objective☆200Updated last month
- EvaByte: Efficient Byte-level Language Models at Scale☆110Updated 6 months ago
- DeMo: Decoupled Momentum Optimization☆197Updated 11 months ago
- Official repo of paper LM2☆46Updated 9 months ago
- Library for text-to-text regression, applicable to any input string representation and allows pretraining and fine-tuning over multiple r…☆287Updated this week
- Simple & Scalable Pretraining for Neural Architecture Research☆299Updated 2 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆172Updated 4 months ago
- Open source interpretability artefacts for R1.☆163Updated 6 months ago
- ☆126Updated 10 months ago
- Benchmarking Agentic LLM and VLM Reasoning On Games☆204Updated 3 months ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆148Updated last month
- ☆143Updated 2 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆189Updated 8 months ago
- ☆88Updated last year
- PyTorch implementation of models from the Zamba2 series.☆185Updated 9 months ago
- Implementation of SOAR☆43Updated 2 months ago
- ☆105Updated 3 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Updated 6 months ago
- Train your own SOTA deductive reasoning model☆107Updated 8 months ago
- ☆122Updated this week
- Storing long contexts in tiny caches with self-study☆216Updated last month
- ☆200Updated 3 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆233Updated 4 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated 11 months ago
- ☆106Updated 3 weeks ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆131Updated 2 weeks ago