apple / ml-dataset-decomposition
Official repo of dataset-decomposition paper [NeurIPS 2024]
☆14Updated 2 months ago
Alternatives and similar repositories for ml-dataset-decomposition:
Users that are interested in ml-dataset-decomposition are comparing it to the libraries listed below
- Minimum Description Length probing for neural network representations☆19Updated 2 months ago
- GoldFinch and other hybrid transformer components☆10Updated 2 weeks ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated last week
- JAX Scalify: end-to-end scaled arithmetics☆15Updated 5 months ago
- Using FlexAttention to compute attention with different masking patterns☆42Updated 6 months ago
- [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers☆12Updated last week
- ☆12Updated 7 months ago
- ☆18Updated 8 months ago
- ☆18Updated 10 months ago
- Official Code Repository for the paper "Key-value memory in the brain"☆24Updated last month
- We study toy models of skill learning.☆24Updated 2 months ago
- Aioli: A unified optimization framework for language model data mixing☆22Updated 2 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆26Updated 6 months ago
- Code for the paper "Function-Space Learning Rates"☆17Updated last month
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆28Updated 2 weeks ago
- A repository for research on medium sized language models.☆76Updated 10 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆22Updated 7 months ago
- GoldFinch and other hybrid transformer components☆45Updated 8 months ago
- ☆33Updated last year
- Combining SOAP and MUON☆13Updated last month
- ☆32Updated 9 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 10 months ago
- Training hybrid models for dummies.☆20Updated 2 months ago
- The repository contains code for Adaptive Data Optimization☆20Updated 3 months ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated 9 months ago
- ☆31Updated last year
- ☆31Updated 2 months ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated last year
- ☆21Updated 3 months ago
- Implementation of Spectral State Space Models☆16Updated last year