Alternatives and similar repositories for GLU

Users that are interested in GLU are comparing it to the libraries listed below

• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆129Updated 2 years ago
• YeonwooSung / Pytorch_mixture-of-experts
  PyTorch implementation of moe, which stands for mixture of experts
  ☆51Updated 4 years ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆52Updated last year
• soumik12345 / Vision-Transformer
  Tensorflow 2.x implementation of Vision-Transformer model
  ☆19Updated 4 years ago
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆119Updated last month
• angry-kratos / Simple_Llama3_from_scratch
  ☆30Updated last year
• aykutcayir34 / DifferentialTransformer
  ☆13Updated last year
• suvoooo / Learn-TensorFlow
  Learning Tensorflow Step by Step:: Concepts, Examples & Applications
  ☆56Updated 5 months ago
• rasbt / cvpr2023
  ☆134Updated 2 years ago
• tensorops / TransformerX
  Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)
  ☆53Updated last year
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆134Updated last year
• Rishit-dagli / Conformer
  An implementation of Conformer: Convolution-augmented Transformer for Speech Recognition, a Transformer Variant in TensorFlow/Keras
  ☆45Updated 3 years ago
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated 2 years ago
• InnovAIco / Google-earth-Object-Recognition
  Object recognition in satellite images (Dior Dataset) using RetinaNet and YoloV5
  ☆19Updated 4 years ago
• josehoras / Knowledge-Distillation
  ☆11Updated 5 years ago
• EscVM / EscVM_YT
  EscVM YouTube Channel Repository. Start from Notebooks ⬅️
  ☆64Updated last year
• microsoft / CASPR
  CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.
  ☆39Updated 2 years ago
• ashishpatel26 / IBM-Quantum-Challenge-Spring-2023-Challenge
  IBM Quantum Challenge Fall 2023
  ☆10Updated 2 years ago
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆53Updated last year
• ashishpatel26 / Vision-Transformer-Keras-Tensorflow-Pytorch-Examples
  Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformer
  ☆110Updated 4 years ago
• lucidrains / contrastive-rl
  Contrastive Reinforcement Learning
  ☆47Updated last week
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆15Updated last year
• The-AI-Summer / learn-deep-learning
  AI Summer's complete catalog of articles
  ☆112Updated 3 years ago
• ShaderManager / RetNet
  PyTorch implementation of Retentive Network: A Successor to Transformer for Large Language Models
  ☆14Updated 2 years ago
• ShivamRajSharma / Transformer-Architectures-From-Scratch
  Implementation of transformers based architecture in PyTorch.
  ☆54Updated 4 years ago
• p-giakoumoglou / pyssl
  Self-Supervised Learning in PyTorch
  ☆142Updated last year
• DavidLandup0 / deepvision
  PyTorch and TensorFlow/Keras image models with automatic weight conversions and equal API/implementations - Vision Transformer (ViT), Res…
  ☆38Updated 2 years ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆49Updated last year
• Lightning-AI / tutorials
  Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
  ☆318Updated 3 months ago
• sayakpaul / swin-transformers-tf
  Implementation of Swin Transformers in TensorFlow along with converted pre-trained models, code for off-the-shelf classification and fine…
  ☆60Updated 3 years ago