Alternatives and similar repositories for Transformer-Architectures-From-Scratch:

Users that are interested in Transformer-Architectures-From-Scratch are comparing it to the libraries listed below

• shivram1987 / ActivationFunctions
  ☆49Updated 2 years ago
• ShivamRajSharma / Transformer-Text-To-Speech
  Pytorch implementation of Transformer-TTS for converting text into speech.
  ☆19Updated 3 years ago
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆130Updated 11 months ago
• The-AI-Summer / JAX-examples
  A set of of fundamental operations and deep learning models using JAX
  ☆13Updated 4 years ago
• gsurma / cnn_explainer
  Making CNNs interpretable.
  ☆19Updated 3 years ago
• shibuiwilliam / mixture_of_experts_keras
  Mixture of experts on convolutional neural network using Keras and Cifar10
  ☆28Updated 7 years ago
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆39Updated this week
• myscience / mamba
  Pytorch (Lightning) implementation of the Mamba model
  ☆26Updated this week
• erksch / fnet-pytorch
  Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.
  ☆73Updated 2 years ago
• soumik12345 / Vision-Transformer
  Tensorflow 2.x implementation of Vision-Transformer model
  ☆19Updated 4 years ago
• wileyw / DeepLearningDemos
  Deep Learning Experiment Code.
  ☆19Updated 8 months ago
• Lornatang / GAN-PyTorch
  A complete implementation of the Pytorch neural network framework for GAN
  ☆24Updated 3 years ago
• Flawless1202 / Non-AR-Spatial-Temporal-Transformer
  Implementation of the paper NAST: Non-Autoregressive Spatial-Temporal Transformer for Time Series Forecasting.
  ☆76Updated 4 years ago
• kyegomez / SparseAttention
  Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
  ☆78Updated 2 weeks ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆71Updated last year
• ShivamRajSharma / Teacher-Student-Network
  PyTorch implementation of Teacher-Student Network(Knowledge Distillation).
  ☆26Updated 3 years ago
• mlsquare / xKAN
  Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc
  ☆33Updated 11 months ago
• aybchan / uber-time-series
  Bayesian time series prediction
  ☆65Updated 4 years ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆50Updated 6 months ago
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆119Updated 3 weeks ago
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆54Updated last year
• lucidrains / adjacent-attention-network
  Graph neural network message passing reframed as a Transformer with local attention
  ☆68Updated 2 years ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆52Updated 3 weeks ago
• sayakpaul / parameter-ensemble-differential-evolution
  Shows how to do parameter ensembling using differential evolution.
  ☆10Updated 3 years ago
• reddragon / efficient-dl-survey-paper
  Efficient Deep Learning Survey Paper
  ☆33Updated 2 years ago
• rish-16 / mlp-mixer-tf
  Unofficial Implementation of MLP-Mixer in TensorFlow
  ☆27Updated 3 years ago
• matthias-wright / jax-fid
  FID computation in Jax/Flax.
  ☆27Updated 9 months ago
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆61Updated 11 months ago
• lich99 / TiDE
  Unofficial Implementation of Long-term Forecasting with TiDE: Time-series Dense Encoder
  ☆53Updated last year
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆89Updated 9 months ago