willGuimont / learnable_fourier_positional_encoding
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
☆42Updated last month
Related projects ⓘ
Alternatives and complementary repositories for learnable_fourier_positional_encoding
- open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689☆51Updated 2 years ago
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆115Updated last year
- A collection of differentiable SVD methods and ICCV21 "Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance P…☆69Updated last year
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆77Updated 10 months ago
- Code for the paper Self-Supervised Learning of Split Invariant Equivariant Representations☆26Updated last year
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- (ICML 2022) Official PyTorch implementation of “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Rob…☆77Updated 2 years ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆97Updated 2 years ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆76Updated 10 months ago
- ☆19Updated 3 years ago
- ☆25Updated 3 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆112Updated last year
- A simple cross attention that updates both the source and target in one step☆152Updated 6 months ago
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆23Updated last year
- Code repository of the paper "CKConv: Continuous Kernel Convolution For Sequential Data" published at ICLR 2022. https://arxiv.org/abs/21…☆119Updated last year
- Differentiable Top-k Classification Learning☆77Updated last year
- Transformers w/o Attention, based fully on MLPs☆89Updated 7 months ago
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆45Updated 2 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆73Updated 4 years ago
- Official PyTorch implementation of A Quaternion-Valued Variational Autoencoder (QVAE).☆27Updated 2 years ago
- Official implementation of ICML 2024 paper "Matrix Information Theory for Self-supervised Learning" (https://arxiv.org/abs/2305.17326)☆27Updated 2 months ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- State Space Models☆63Updated 6 months ago
- Advanced Dropout: A Model-free Methodology for Bayesian Dropout Optimization (IEEE TPAMI 2021)☆17Updated 3 years ago
- [ICML2023] InfoOT: Information Maximizing Optimal Transport☆40Updated last year
- Official Pytorch Implementation for "Continual Transformers: Redundancy-Free Attention for Online Inference" [ICLR 2023]☆28Updated last year
- This is a offical PyTorch/GPU implementation of SupMAE.☆77Updated 2 years ago
- Unofficial pytorch implementation of the paper "Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding", NeurIPS 20…☆13Updated 7 months ago
- ☆62Updated last month
- ☆87Updated 10 months ago