stanislavfort / dissect-git-re-basin
Replicating and dissecting the git-re-basin project in one-click-replication Colabs
☆36Updated 2 years ago
Related projects: ⓘ
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆69Updated last year
- ☆42Updated 3 months ago
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆43Updated 7 months ago
- A centralized place for deep thinking code and experiments☆73Updated last year
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆34Updated last year
- ☆68Updated 3 weeks ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆77Updated last year
- ☆46Updated 7 months ago
- Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]☆81Updated last year
- Transformers with doubly stochastic attention☆40Updated 2 years ago
- Scalable neural net training via automatic normalization in the modular norm.☆108Updated 3 weeks ago
- Easy Hypernetworks in Pytorch and Jax☆94Updated last year
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆57Updated last year
- ☆52Updated last month
- ☆57Updated 2 years ago
- Python library for argument and configuration management☆53Updated last year
- Personal implementation of ASIF by Antonio Norelli☆23Updated 3 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆57Updated 10 months ago
- Code repository for the paper "Meta-Learning via Classifier(-free) Diffusion Guidance"☆30Updated last year
- ☆48Updated 8 months ago
- ☆68Updated 7 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆84Updated 4 months ago
- Apply methods described in "Git Re-basin"-paper [1] to arbitrary models --- [1] Ainsworth et al. (https://arxiv.org/abs/2209.04836)☆11Updated this week
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆19Updated 9 months ago
- Why Do We Need Weight Decay in Modern Deep Learning? [arXiv, Oct 2023]☆41Updated 11 months ago
- ☆48Updated 3 months ago
- Model Zoos published at the NeurIPS 2022 Dataset & Benchmark track: "Model Zoos: A Dataset of Diverse Populations of Neural Network Model…☆51Updated last year
- ☆47Updated 3 months ago
- ☆35Updated 7 months ago
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆66Updated last month