Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
☆59Jan 14, 2022Updated 4 years ago
Alternatives and similar repositories for FISH
Users that are interested in FISH are comparing it to the libraries listed below
Sorting:
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆75Aug 9, 2024Updated last year
- Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020☆29Jan 6, 2022Updated 4 years ago
- Codebase for multilingual neural machine translation☆13Nov 24, 2022Updated 3 years ago
- ☆13May 21, 2024Updated last year
- Python-based Blender module for scientific visualization☆12Oct 2, 2018Updated 7 years ago
- ☆31May 26, 2021Updated 4 years ago
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆30Jul 12, 2020Updated 5 years ago
- AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION☆14Oct 27, 2023Updated 2 years ago
- Implementation for the paper "Learning Invariant Representation for Continual Learning" in PyTorch.☆12Jan 31, 2021Updated 5 years ago
- ☆12Jul 17, 2023Updated 2 years ago
- This code accompanies the paper "Information-Theoretic Probing for Linguistic Structure" published in ACL 2020.☆21Apr 27, 2020Updated 5 years ago
- Author implementation of Monte Carlo Augmented Actor Critic in PyTorch☆18Oct 24, 2022Updated 3 years ago
- ☆17Jun 20, 2024Updated last year
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆66Aug 15, 2025Updated 6 months ago
- Lottery Tickets in Evolutionary Optimization (Lange & Sprekeler, ICML 2023)☆17Jun 2, 2023Updated 2 years ago
- Variational Reinforcement Learning☆17Jul 25, 2024Updated last year
- Pytorch Implementation for "Preserving Linear Separability in Continual Learning by Backward Feature Projection" (CVPR 2023)☆18Jun 29, 2023Updated 2 years ago
- Hugging Face and Pyserini interoperability☆19May 18, 2023Updated 2 years ago
- Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]☆39May 28, 2024Updated last year
- Pile Deduplication Code☆18May 15, 2023Updated 2 years ago
- Task Compass: Scaling Multi-task Pre-training with Task Prefix (EMNLP 2022: Findings) (stay tuned & more will be updated)☆22Oct 17, 2022Updated 3 years ago
- code repo for EMNLP'21 Finding Counter-Interference Adapter for Multilingual Machine Translation☆18Oct 19, 2022Updated 3 years ago
- Experiments for "A Closer Look at In-Context Learning under Distribution Shifts"☆19May 29, 2023Updated 2 years ago
- Code associated with the NeurIPS19 paper "Weighted Linear Bandits in Non-Stationary Environments"☆17Nov 14, 2019Updated 6 years ago
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tran…☆18Oct 18, 2022Updated 3 years ago
- Source code of our paper "Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation" @ACL-2022☆18May 19, 2022Updated 3 years ago
- Computationally friendly hyper-parameter search with DP-SGD☆25Jan 7, 2025Updated last year
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆45Nov 11, 2023Updated 2 years ago
- [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"☆20Sep 15, 2023Updated 2 years ago
- ☆21Mar 15, 2023Updated 2 years ago
- ☆20Dec 16, 2020Updated 5 years ago
- ☆30Jun 19, 2023Updated 2 years ago
- ☆29Mar 1, 2024Updated 2 years ago
- Entailment self-training☆27May 30, 2023Updated 2 years ago
- Soft Threshold Weight Reparameterization for Learnable Sparsity☆91Feb 15, 2023Updated 3 years ago
- Understanding RL vision Distill article☆25Mar 3, 2023Updated 3 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Oct 29, 2023Updated 2 years ago
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆57Aug 25, 2024Updated last year
- ☆41Feb 20, 2026Updated 2 weeks ago