The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We develop a method for analyzing emerging functional modularity in neural networks based on differentiable weight masks and use it to point out important issues in current-day neural networks.
☆46Oct 3, 2023Updated 2 years ago
Alternatives and similar repositories for modules
Users that are interested in modules are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers☆43Feb 12, 2025Updated last year
- ☆35Mar 13, 2021Updated 5 years ago
- Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection☆23Jan 21, 2021Updated 5 years ago
- ☆10Jun 12, 2021Updated 5 years ago
- Offical Repo for Splitting Steepest Descent for Growing Neural Architectures☆13May 12, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Pytorch implementation of the paper 'Compositional language emerge in a neural iterated learning' (ICLR 2020).☆16Oct 14, 2021Updated 4 years ago
- ☆14Apr 8, 2021Updated 5 years ago
- Learning perturbation sets for robust machine learning☆65Aug 23, 2021Updated 4 years ago
- Official code for the paper: "Metadata Archaeology"☆19May 10, 2023Updated 3 years ago
- Code accompanying our paper "Finding trainable sparse networks through Neural Tangent Transfer" to be published at ICML-2020.☆13Jun 14, 2020Updated 6 years ago
- "Predict, then Interpolate: A Simple Algorithm to Learn Stable Classifiers" ICML 2021☆17Jun 1, 2021Updated 5 years ago
- ☆24Jun 7, 2021Updated 5 years ago
- Hierarchical Universal Modular ANotator☆12May 9, 2026Updated last month
- ☆34Apr 19, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [NeurIPS 2020 Oral] Is normalization indispensable for training deep neural networks?☆34Jun 22, 2022Updated 4 years ago
- Open-source strong baseline for domain generlization re-ID. We will udpate the strong baseline and CFD method~☆10Nov 30, 2021Updated 4 years ago
- Ordered Preference Elicitation Strategies for Multi-Objective Decision Making using Gaussian Processes☆23Jul 25, 2018Updated 7 years ago
- Code for the paper: Kernel Distributionally Robust Optimization☆13Feb 21, 2021Updated 5 years ago
- ☆40Jul 24, 2025Updated 11 months ago
- Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""☆23Jun 13, 2025Updated last year
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆66Dec 16, 2022Updated 3 years ago
- A neural-symbolic joint reasoning approach for Natural Language Inference (NLI). Modeling NLI as inference path planning through a search…☆17Jun 9, 2021Updated 5 years ago
- An extensible benchmark suite to evaluate data-driven physical simulation☆34Dec 8, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Generative Equilibrium Transformer☆28Nov 11, 2023Updated 2 years ago
- Code for our paper "Informative Dropout for Robust Representation Learning: A Shape-bias Perspective" (ICML 2020)☆126Dec 8, 2022Updated 3 years ago
- Code for "Semantic Perturbations with Normalizing Flows for Improved Generalization"☆11Jul 13, 2021Updated 4 years ago
- Code for paper "When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Data"☆14Feb 16, 2021Updated 5 years ago
- ☆12Aug 10, 2023Updated 2 years ago
- ☆14Aug 20, 2019Updated 6 years ago
- Poincare Embeddings for Word Vector Representations☆18Oct 29, 2017Updated 8 years ago
- Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator support…☆38Jul 27, 2023Updated 2 years ago
- MetaGenRL, a novel meta reinforcement learning algorithm. Unlike prior work, MetaGenRL can generalize to new environments that are entire…☆71Jun 5, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Effective Abstract Reasoning with Dual-Contrast Network☆11Jun 25, 2021Updated 5 years ago
- Code for "Supermasks in Superposition"☆126Oct 3, 2023Updated 2 years ago
- experiments for Course 'Advanced Operation System'.☆13Mar 19, 2019Updated 7 years ago
- Code for the ICML 2019 paper 'Conditioning by adaptive sampling for robust design'☆37Jun 4, 2021Updated 5 years ago
- direct preference optimization with only 1 model copy :)☆14Oct 2, 2023Updated 2 years ago
- PyTorch utilities for ML, specifically speech☆13Jan 30, 2024Updated 2 years ago
- [EMNLP 2022] Language Model Pre-Training with Sparse Latent Typing☆14Feb 10, 2023Updated 3 years ago