OATML / RHO-LossLinks
☆208Updated 2 years ago
Alternatives and similar repositories for RHO-Loss
Users that are interested in RHO-Loss are comparing it to the libraries listed below
Sorting:
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆207Updated last year
- ☆163Updated 2 years ago
- Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)☆231Updated 3 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 3 years ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated last year
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆150Updated 2 years ago
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆252Updated 2 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆80Updated last year
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆214Updated 2 years ago
- Code release for "Dropout Reduces Underfitting"☆313Updated 2 years ago
- ☆166Updated last year
- Unofficial JAX implementations of deep learning research papers☆156Updated 2 years ago
- ☆74Updated 2 years ago
- A fast, effective data attribution method for neural networks in PyTorch☆211Updated 6 months ago
- Named tensors with first-class dimensions for PyTorch☆331Updated last year
- Differentiable Sorting Networks☆115Updated last year
- Train ImageNet *fast* in 500 lines of code with FFCV☆142Updated last year
- Optimal Transport Dataset Distance☆164Updated 3 years ago
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆204Updated last year
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆41Updated 2 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆100Updated 2 years ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆75Updated 2 years ago
- ☆67Updated 3 years ago
- A library to inspect and extract intermediate layers of PyTorch models.☆473Updated 3 years ago
- An active learning library for Pytorch based on Lightning-Fabric.☆79Updated last year
- Sequence modeling with Mega.☆295Updated 2 years ago
- Convert scikit-learn models to PyTorch modules☆163Updated last year
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆135Updated 2 months ago
- Sequence Modeling with Structured State Spaces☆64Updated 2 years ago