VsonicV / es-fine-tuning-paperLinks
This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"
☆277Updated last month
Alternatives and similar repositories for es-fine-tuning-paper
Users that are interested in es-fine-tuning-paper are comparing it to the libraries listed below
Sorting:
- RLP: Reinforcement as a Pretraining Objective☆218Updated 2 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆174Updated 11 months ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆120Updated last month
- EvaByte: Efficient Byte-level Language Models at Scale☆111Updated 8 months ago
- Open source interpretability artefacts for R1.☆165Updated 8 months ago
- ☆162Updated 4 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆305Updated 3 weeks ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆198Updated last year
- DeMo: Decoupled Momentum Optimization☆198Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆122Updated 2 months ago
- ☆91Updated last year
- Official repo of paper LM2☆46Updated 10 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆190Updated 9 months ago
- ☆125Updated 10 months ago
- Storing long contexts in tiny caches with self-study☆228Updated 3 weeks ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆234Updated 5 months ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆149Updated 2 months ago
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆62Updated 2 months ago
- 📄Small Batch Size Training for Language Models☆69Updated 2 months ago
- ☆131Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆246Updated last week
- ☆116Updated 3 weeks ago
- ☆147Updated 3 months ago
- Train your own SOTA deductive reasoning model☆107Updated 9 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 8 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆152Updated 10 months ago
- Implementation of SOAR☆46Updated 3 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆73Updated 8 months ago
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆341Updated last month
- ☆131Updated 2 weeks ago