jloveric / high-order-layers-torchLinks
High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial (Chebyshev nodes) and Fourier Series layers of arbitrary order. Piecewise implementations could be thought of as a 1d grid (for each neuron) where each grid element is Lagrange polynomial. Both full connecte…
☆44Updated last year
Alternatives and similar repositories for high-order-layers-torch
Users that are interested in high-order-layers-torch are comparing it to the libraries listed below
Sorting:
- A State-Space Model with Rational Transfer Function Representation.☆83Updated last year
- Deep Networks Grok All the Time and Here is Why☆38Updated last year
- Diffusion models in PyTorch☆120Updated 2 weeks ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Updated 2 years ago
- Recursive Leasting Squares (RLS) with Neural Network for fast learning☆58Updated 2 years ago
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated last year
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆81Updated last year
- ☆153Updated last month
- ☆97Updated last year
- Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc☆35Updated last year
- The 2D discrete wavelet transform for JAX☆43Updated 2 years ago
- C++ and Cuda ops for fused FourierKAN☆82Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆92Updated last year
- Official repo for BWLer: Barycentric Weight Layer☆28Updated 2 months ago
- Free-form flows are a generative model training a pair of neural networks via maximum likelihood☆50Updated 5 months ago
- Implicit Convolutional Kernels for Steerable CNNs [NeurIPS'23]☆30Updated 9 months ago
- This code implements a Radial Basis Function (RBF) based Kolmogorov-Arnold Network (KAN) for function approximation.☆29Updated last year
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆51Updated last year
- We integrate discrete diffusion models with neurosymbolic predictors for scalable and calibrated learning and reasoning☆54Updated 2 weeks ago
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆107Updated 2 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated 11 months ago
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆68Updated last month
- Toy genetic algorithm in Pytorch☆54Updated 7 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆91Updated last year
- ☆33Updated last year
- Clifford-Steerable Convolutional Neural Networks [ICML'24]☆51Updated 7 months ago
- Benchmark for efficiency in memory and time of different KAN implementations.☆136Updated last year
- ☆62Updated last year
- ☆16Updated 3 years ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆105Updated last year