Nicolas-Yax / PhyloLM
Genetics for Language Models
☆13Updated 8 months ago
Alternatives and similar repositories for PhyloLM:
Users that are interested in PhyloLM are comparing it to the libraries listed below
- Universal Neurons in GPT2 Language Models☆27Updated 9 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆123Updated 11 months ago
- Latent Program Network (from the "Searching Latent Program Spaces" paper)☆72Updated 2 weeks ago
- Repository for the paper Stream of Search: Learning to Search in Language☆142Updated last month
- ☆53Updated last year
- Functional Benchmarks and the Reasoning Gap☆84Updated 5 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆71Updated 4 months ago
- ☆84Updated 8 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆72Updated 4 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆186Updated 10 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆103Updated 4 months ago
- Replicating O1 inference-time scaling laws☆83Updated 3 months ago
- Minimal but scalable implementation of large language models in JAX☆34Updated 4 months ago
- Evaluation of neuro-symbolic engines☆35Updated 7 months ago
- ☆124Updated this week
- LLMs represent numbers on a helix and manipulate that helix to do addition.☆21Updated last month
- σ-GPT: A New Approach to Autoregressive Models☆62Updated 7 months ago
- Bootstrapping ARC☆104Updated 4 months ago
- A set of Python scripts that makes your experience on TPU better☆50Updated 8 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆135Updated 2 weeks ago
- ☆48Updated 4 months ago
- ☆26Updated last year
- Automated Design of Agentic Systems☆10Updated 6 months ago
- Learn online intrinsic rewards from LLM feedback☆35Updated 3 months ago
- ☆74Updated 7 months ago
- nanoGPT-like codebase for LLM training☆91Updated last week
- The repository contains code for Adaptive Data Optimization☆20Updated 3 months ago
- PyTorch library for Active Fine-Tuning☆61Updated last month