ShivamRajSharma / Transformer-Architectures-From-Scratch

Related projects ⓘ

Alternatives and complementary repositories for Transformer-Architectures-From-Scratch

• ShivamRajSharma / Teacher-Student-Network
  PyTorch implementation of Teacher-Student Network(Knowledge Distillation).
  ☆23Updated 3 years ago
• shivram1987 / ActivationFunctions
  ☆47Updated 2 years ago
• Mayurji / Pytorch-Lightning-Face-Recognition
  The Objective is to implement Siamese Network for Face Recognition using Pytorch Lightning.
  ☆17Updated 3 years ago
• The-AI-Summer / pytorch-ddp
  code for the ddp tutorial
  ☆32Updated 2 years ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆40Updated last month
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆42Updated 11 months ago
• 0aqz0 / pytorch-attention-mechanism
  my codes for learning attention mechanism
  ☆50Updated 4 years ago
• Doobrovskiy / depthwiseconv1d
  Keras 1D Depthwise Convolutional layer
  ☆10Updated 4 years ago
• landskape-ai / Progressive-Pruning
  Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)
  ☆17Updated last year
• kyegomez / SparseAttention
  Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
  ☆60Updated last week
• The-AI-Summer / RNN_tutorial
  Recurrent neural networks: building a custom LSTM/GRU cell in PyTorch
  ☆28Updated 4 years ago
• codeaway23 / MLPNAS
  MLPNAS code for Paperspace series on Neural Architecture Search
  ☆22Updated last year
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆50Updated last week
• reddragon / efficient-dl-survey-paper
  Efficient Deep Learning Survey Paper
  ☆32Updated last year
• AlessandroSaviolo / CNN-from-Scratch
  Convolutional Neural Network implemented from Scratch for MNIST and CIFAR-10 datasets.
  ☆55Updated 2 years ago
• elliotwaite / pytorch-hooks-tutorial
  Examples of using PyTorch hooks, as covered in my YouTube tutorial video.
  ☆32Updated last year
• LukeWood / reef-net
  ☆24Updated 2 years ago
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆86Updated 4 months ago
• Borda / kaggle_image-classify
  Various Kaggle image classification challenges solutions
  ☆41Updated last month
• tcapelle / moving_mnist
  Exploring Moving Mnist dataset with forecasting algorithms
  ☆31Updated last year
• rish-16 / mlp-mixer-tf
  Unofficial Implementation of MLP-Mixer in TensorFlow
  ☆26Updated 3 years ago
• sayakpaul / BiT-jax2tf
  This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.
  ☆14Updated 2 years ago
• sayakpaul / AdaMatch-TF
  Includes additional materials for the following keras.io blog post.
  ☆12Updated 3 years ago
• The-AI-Summer / JAX-examples
  A set of of fundamental operations and deep learning models using JAX
  ☆13Updated 3 years ago
• deep-diver / LoRA-deployment
  LoRA fine-tuned Stable Diffusion Deployment
  ☆31Updated last year
• ahundt / sharpDARTS
  sharpDARTS: Faster and More Accurate Differentiable Architecture Search
  ☆16Updated 3 years ago
• ChristophReich1996 / HyperMixer
  PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].
  ☆17Updated 2 years ago
• innat / HybridModel-GradCAM
  A Keras implementation of hybrid efficientnet swin transformer model.
  ☆33Updated last year
• cosmo3769 / Quantized-LLMs
  Quantization of LLMs and benchmarking.
  ☆10Updated 7 months ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆66Updated last year