jloveric / high-order-layers-torch
High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial (Chebyshev nodes) and Fourier Series layers of arbitrary order. Piecewise implementations could be thought of as a 1d grid (for each neuron) where each grid element is Lagrange polynomial. Both full connecte…
☆44Updated 10 months ago
Alternatives and similar repositories for high-order-layers-torch
Users that are interested in high-order-layers-torch are comparing it to the libraries listed below
Sorting:
- A State-Space Model with Rational Transfer Function Representation.☆78Updated last year
- Clifford-Steerable Convolutional Neural Networks [ICML'24]☆48Updated last week
- ☆53Updated 7 months ago
- Diffusion models in PyTorch☆101Updated last month
- Kolmogorov-Arnold networks (KAN) as implicit functions (like NeRF but simpler)☆14Updated last year
- ☆88Updated 11 months ago
- Repo to the paper "Lie Point Symmetry Data Augmentation for Neural PDE Solvers"☆50Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- Free-form flows are a generative model training a pair of neural networks via maximum likelihood☆44Updated 3 months ago
- Deep Networks Grok All the Time and Here is Why☆34Updated 11 months ago
- Implicit Convolutional Kernels for Steerable CNNs [NeurIPS'23]☆29Updated 2 months ago
- This code implements a Radial Basis Function (RBF) based Kolmogorov-Arnold Network (KAN) for function approximation.☆28Updated 11 months ago
- The 2D discrete wavelet transform for JAX☆43Updated 2 years ago
- ☆181Updated 5 months ago
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 3 months ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆124Updated last year
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆59Updated 2 weeks ago
- ☆32Updated 7 months ago
- C++ and Cuda ops for fused FourierKAN☆78Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆99Updated 8 months ago
- ☆12Updated last year
- Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc☆34Updated last year
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆50Updated 9 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆88Updated 10 months ago
- ☆31Updated last year
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆81Updated last year
- Benchmark for efficiency in memory and time of different KAN implementations.☆123Updated 8 months ago
- A simple example of VAEs with KANs☆12Updated last year
- Lightning-like training API for JAX with Flax☆38Updated 5 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆100Updated 4 months ago