kyegomez / LiqudNetLinks
Implementation of Liquid Nets in Pytorch
☆67Updated 2 months ago
Alternatives and similar repositories for LiqudNet
Users that are interested in LiqudNet are comparing it to the libraries listed below
Sorting:
- Tutorial to implement Liquid Time-Constant Neural Network from scratch (eng\rus)☆25Updated last year
- Oscillatory State-Space Models☆88Updated 3 months ago
- ☆121Updated 2 weeks ago
- Pytorch (Lightning) implementation of the Mamba model☆29Updated 2 months ago
- A State-Space Model with Rational Transfer Function Representation.☆78Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆119Updated last year
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆57Updated this week
- Liquid Structural State-Space Models☆360Updated last year
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆119Updated 8 months ago
- A HuggingFace compatible Small Language Model trainer.☆75Updated 4 months ago
- TensorFlow implementation of Liquid Time-Constant Neural Network layers☆21Updated 3 years ago
- Implementation of a Light Recurrent Unit in Pytorch☆48Updated 8 months ago
- Gradient Boosting Reinforcement Learning (GBRL)☆114Updated 3 weeks ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆101Updated 6 months ago
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆108Updated 7 months ago
- FlashRNN - Fast RNN Kernels with I/O Awareness☆91Updated 2 weeks ago
- Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public☆85Updated last week
- Implementation of the proposed minGRU in Pytorch☆299Updated 3 months ago
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆64Updated 3 weeks ago
- An open source implementation of LFMs from Liquid AI: Liquid Foundation Models☆98Updated 8 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆89Updated last year
- An open source implementation of LFMs from Liquid AI: Liquid Foundation Models☆168Updated last month
- ☆292Updated 5 months ago
- Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)☆46Updated last year
- Collection of autoregressive model implementation☆85Updated 2 months ago
- A byte-level decoder architecture that matches the performance of tokenized Transformers.☆63Updated last year
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆56Updated last year
- Experiments in Joint Embedding Predictive Architectures (JEPAs).☆41Updated last year
- SaLSa Optimizer implementation (No learning rates needed)☆30Updated last month
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆82Updated last year