jloveric / high-order-layers-torchLinks
High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial (Chebyshev nodes) and Fourier Series layers of arbitrary order. Piecewise implementations could be thought of as a 1d grid (for each neuron) where each grid element is Lagrange polynomial. Both full connecte…
☆45Updated last year
Alternatives and similar repositories for high-order-layers-torch
Users that are interested in high-order-layers-torch are comparing it to the libraries listed below
Sorting:
- A State-Space Model with Rational Transfer Function Representation.☆81Updated last year
- Deep Networks Grok All the Time and Here is Why☆37Updated last year
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆65Updated last month
- ☆58Updated 11 months ago
- Diffusion models in PyTorch☆111Updated last week
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Updated last year
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆50Updated last year
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆87Updated last year
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 8 months ago
- Recursive Leasting Squares (RLS) with Neural Network for fast learning☆56Updated last year
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆106Updated 10 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆101Updated 9 months ago
- Free-form flows are a generative model training a pair of neural networks via maximum likelihood☆47Updated 3 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated last year
- Official PyTorch and JAX Implementation of "Harmonics of Learning: Universal Fourier Features Emerge in Invariant Networks"☆38Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆90Updated last year
- Implicit Convolutional Kernels for Steerable CNNs [NeurIPS'23]☆29Updated 7 months ago
- ☆96Updated last year
- This code implements a Radial Basis Function (RBF) based Kolmogorov-Arnold Network (KAN) for function approximation.☆29Updated last year
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding☆56Updated 11 months ago
- Clifford-Steerable Convolutional Neural Networks [ICML'24]☆49Updated 4 months ago
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆29Updated 5 years ago
- We integrate discrete diffusion models with neurosymbolic predictors for scalable and calibrated learning and reasoning☆45Updated 4 months ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆103Updated 10 months ago
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆108Updated last month
- Official Implementation of the ICML 2023 paper: "Neural Wave Machines: Learning Spatiotemporally Structured Representations with Locally …☆73Updated 2 years ago
- C++ and Cuda ops for fused FourierKAN☆80Updated last year
- Toy genetic algorithm in Pytorch☆53Updated 4 months ago
- Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc☆35Updated last year
- Benchmark for efficiency in memory and time of different KAN implementations.☆132Updated last year