jloveric / high-order-layers-torchLinks
High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial (Chebyshev nodes) and Fourier Series layers of arbitrary order. Piecewise implementations could be thought of as a 1d grid (for each neuron) where each grid element is Lagrange polynomial. Both full connecte…
☆45Updated last year
Alternatives and similar repositories for high-order-layers-torch
Users that are interested in high-order-layers-torch are comparing it to the libraries listed below
Sorting:
- A State-Space Model with Rational Transfer Function Representation.☆79Updated last year
- Deep Networks Grok All the Time and Here is Why☆37Updated last year
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆125Updated last year
- Diffusion models in PyTorch☆107Updated last month
- Recursive Leasting Squares (RLS) with Neural Network for fast learning☆54Updated last year
- ☆93Updated last year
- Clifford-Steerable Convolutional Neural Networks [ICML'24]☆48Updated 2 months ago
- C++ and Cuda ops for fused FourierKAN☆80Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated 11 months ago
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆50Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆89Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆84Updated last year
- Implicit Convolutional Kernels for Steerable CNNs [NeurIPS'23]☆29Updated 5 months ago
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆106Updated 8 months ago
- ☆53Updated 9 months ago
- Benchmark for efficiency in memory and time of different KAN implementations.☆130Updated 11 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆121Updated last year
- We integrate discrete diffusion models with neurosymbolic predictors for scalable and calibrated learning and reasoning☆39Updated 2 months ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆80Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆101Updated 7 months ago
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆65Updated last month
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 6 months ago
- Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc☆35Updated last year
- Sequence Modeling with Structured State Spaces☆65Updated 2 years ago
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆172Updated 2 years ago
- ☆124Updated last month
- A simple example of VAEs with KANs☆12Updated last year
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆82Updated last year
- Code for "Theoretical Foundations of Deep Selective State-Space Models" (NeurIPS 2024)☆15Updated 6 months ago
- Official Implementation of the ICML 2023 paper: "Neural Wave Machines: Learning Spatiotemporally Structured Representations with Locally …☆72Updated 2 years ago