mcleish7 / gemstone-scaling-lawsLinks
☆25Updated 3 months ago
Alternatives and similar repositories for gemstone-scaling-laws
Users that are interested in gemstone-scaling-laws are comparing it to the libraries listed below
Sorting:
- ☆19Updated 10 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆30Updated 4 months ago
- The repository contains code for Adaptive Data Optimization☆24Updated 5 months ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆87Updated 6 months ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 7 months ago
- Exploration of automated dataset selection approaches at large scales.☆41Updated 3 months ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 4 months ago
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆26Updated 7 months ago
- Simple and scalable tools for data-driven pretraining data selection.☆24Updated 3 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆32Updated 2 months ago
- ☆14Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆89Updated last week
- Sparse Autoencoder Training Library☆52Updated last month
- ☆34Updated 5 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆73Updated 7 months ago
- Universal Neurons in GPT2 Language Models☆29Updated last year
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆10Updated 2 months ago
- ☆18Updated 3 months ago
- ☆44Updated last year
- ☆29Updated 10 months ago
- ☆32Updated 4 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆23Updated last month
- Efficient Scaling laws and collaborative pretraining.☆16Updated 4 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆26Updated last year
- ☆13Updated last month
- ☆49Updated last year
- Aioli: A unified optimization framework for language model data mixing☆25Updated 4 months ago
- ☆54Updated 2 years ago
- ☆14Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated last year