ml-research / rational_activations
Rational Activation Functions - Replacing Padé Activation Units
☆84Updated last year
Alternatives and similar repositories for rational_activations:
Users that are interested in rational_activations are comparing it to the libraries listed below
- Gaussian-Bernoulli Restricted Boltzmann Machines☆101Updated 2 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆63Updated 3 years ago
- ☆59Updated 3 years ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆121Updated last year
- Transformers with doubly stochastic attention☆44Updated 2 years ago
- Code for the paper: Complex-Valued Autoencoders for Object Discovery☆48Updated last year
- Code repository of the paper "CKConv: Continuous Kernel Convolution For Sequential Data" published at ICLR 2022. https://arxiv.org/abs/21…☆119Updated 2 years ago
- Official implementation of Transformer Neural Processes☆71Updated 2 years ago
- Modern Fixed Point Systems using Pytorch☆85Updated last year
- Official code for "Maximum Likelihood Training of Score-Based Diffusion Models", NeurIPS 2021 (spotlight)☆134Updated 3 years ago
- [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)☆21Updated 2 months ago
- ☆172Updated 8 months ago
- Second-Order Neural ODE Optimizer, NeurIPS 2021 spotlight☆52Updated 3 years ago
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆72Updated 9 months ago
- Easy Hypernetworks in Pytorch and Jax☆96Updated 2 years ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆76Updated 7 months ago
- Neural Diffusion Processes☆76Updated 5 months ago
- Code for "'Hey, that's not an ODE:' Faster ODE Adjoints via Seminorms" (ICML 2021)☆86Updated 2 years ago
- Sequence Modeling with Structured State Spaces☆61Updated 2 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆72Updated 6 months ago
- ☆32Updated 2 years ago
- Official code for Long Expressive Memory (ICLR 2022, Spotlight)☆69Updated 2 years ago
- A minimalist implementation of score-based diffusion model☆122Updated 3 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆154Updated last month
- Implementations of various linear RNN layers using pytorch and triton☆49Updated last year
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆51Updated 2 months ago
- PyTorch implementation of the OT-Flow approach in arXiv:2006.00104☆50Updated 6 months ago
- Open source code for EigenGame.☆30Updated last year
- Official repository of Implicit Neural Convolutional Kernels for Steerable CNNs, Zhdanov et al.☆28Updated 10 months ago
- Differentiable Algorithms and Algorithmic Supervision.☆112Updated last year