Alternatives and similar repositories for normalized-attention

Users that are interested in normalized-attention are comparing it to the libraries listed below

• belindal / TaskBench500

  View on GitHub
  Suite of 500 procedurally-generated NLP tasks to study language model adaptability
  ☆21Jul 16, 2022Updated 3 years ago
• photogeniq / image-encoders

  View on GitHub
  🖼️📊
  ☆11Jun 9, 2020Updated 5 years ago
• henripal / maps_webapp

  View on GitHub
  ☆13Nov 12, 2018Updated 7 years ago
• oguiza / DataAugmentation

  View on GitHub
  ☆12Mar 16, 2022Updated 3 years ago
• LeeJuly30 / L-GM-Loss-For-Gluon

  View on GitHub
  MXNet/Gluon implement of L-GM-Loss
  ☆11Oct 17, 2018Updated 7 years ago
• lucidrains / mlp-gpt-jax

  View on GitHub
  A GPT, made only of MLPs, in Jax
  ☆59Jun 23, 2021Updated 4 years ago
• Soonhwan-Kwon / capsnet.mxnet

  View on GitHub
  MXNet implementation of CapsNet
  ☆29Nov 29, 2017Updated 8 years ago
• halcy / tpuddim

  View on GitHub
  ☆22May 3, 2022Updated 3 years ago
• nshepperd / jaxtorch

  View on GitHub
  A JAX nn library
  ☆22Sep 9, 2025Updated 5 months ago
• lucidrains / all-normalization-transformer

  View on GitHub
  A simple Transformer where the softmax has been replaced with normalization
  ☆20Sep 11, 2020Updated 5 years ago
• antofuller / configaformers

  View on GitHub
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆49Nov 30, 2021Updated 4 years ago
• NZ99 / transformer_in_transformer_flax

  View on GitHub
  ☆21Mar 14, 2021Updated 4 years ago
• lucidrains / token-shift-gpt

  View on GitHub
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆49Jan 27, 2022Updated 4 years ago
• RobertCsordas / ndr

  View on GitHub
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆34Jun 11, 2025Updated 8 months ago
• frankaging / Causal-Distill

  View on GitHub
  The Codebase for Causal Distillation for Language Models (NAACL '22)
  ☆26May 1, 2022Updated 3 years ago
• MalteEbner / NNCLR

  View on GitHub
  Implementation of the nearest neighbour CLR paper
  ☆27Mar 17, 2022Updated 3 years ago
• RedRyan111 / GLOM

  View on GitHub
  An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.
  ☆57Mar 29, 2021Updated 4 years ago
• lucidrains / ESBN-pytorch

  View on GitHub
  Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch
  ☆25Jan 6, 2021Updated 5 years ago
• lucidrains / triangle-multiplicative-module

  View on GitHub
  Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …
  ☆39Aug 3, 2021Updated 4 years ago
• sdoria / EfficientNet

  View on GitHub
  Converting EfficientNet to Pytorch for use with fastai
  ☆27Jun 5, 2019Updated 6 years ago
• bunnech / gwgan

  View on GitHub
  Learning Generative Models across Incomparable Spaces (ICML 2019)
  ☆27Mar 11, 2020Updated 5 years ago
• Enealor / PyTorch-SM3

  View on GitHub
  Implements the SM3-II adaptive optimization algorithm for PyTorch.
  ☆33Sep 3, 2024Updated last year
• avisingh599 / cog

  View on GitHub
  [CoRL 2020] COG: Connecting New Skills to Past Experience with Offline Reinforcement Learning
  ☆34Oct 28, 2020Updated 5 years ago
• uber-research / D3G

  View on GitHub
  Estimating Q(s,s') with Deep Deterministic Dynamics Gradients
  ☆32Feb 21, 2020Updated 5 years ago
• wddabc / bist-parser

  View on GitHub
  Graph-based and Transition-based dependency parsers based on BiLSTMs
  ☆30Jan 4, 2019Updated 7 years ago
• nklein23 / mxnet-with-R

  View on GitHub
  ☆13Dec 28, 2018Updated 7 years ago
• uos / transparent_object_reconstruction

  View on GitHub
  Detect and reconstruct transparent objects from scan shadows
  ☆10Sep 22, 2017Updated 8 years ago
• timdavidlee / fastai_dl2019p2

  View on GitHub
  Deep Learning Part 2, 2019 edition - transcriptions, screenshots and notebooks
  ☆11Jul 19, 2019Updated 6 years ago
• aqlaboratory / pnerf

  View on GitHub
  ☆36Jul 22, 2019Updated 6 years ago
• ertsiger / induction-subgoal-automata-rl

  View on GitHub
  Code for the papers "Induction of Subgoal Automata for Reinforcement Learning" (AAAI-20) and "Induction and Exploitation of Subgoal Autom…
  ☆13Aug 15, 2023Updated 2 years ago
• timvieira / rl

  View on GitHub
  Reference implementation of algorithms for reinforcement learning and Markov decision processes.
  ☆12Jan 28, 2021Updated 5 years ago
• lspecia / quest

  View on GitHub
  Pascal2 Harvest project QuEst
  ☆14Sep 15, 2014Updated 11 years ago
• lnsmith54 / BOSS

  View on GitHub
  This repository provides the code for replicating the experiments in the paper "Building One-Shot Semi-supervised (BOSS) Learning up to F…
  ☆36Aug 9, 2020Updated 5 years ago
• xuyuting45 / DSB2018-mx-unet

  View on GitHub
  An implement of U-net using MXNet gluon
  ☆11Apr 3, 2018Updated 7 years ago
• pengbohua / AngularGap

  View on GitHub
  ☆13Jul 20, 2023Updated 2 years ago
• ySalaun / deblur_denoise

  View on GitHub
  College project about article http://www.cs.ust.hk/~quan/publications/yuan-deblur-siggraph07.pdf
  ☆10Jan 25, 2013Updated 13 years ago
• isdata-org / mapping-the-bioeconomy

  View on GitHub
  Topic modelling and co-occurrence analysis of the bio-economy
  ☆10Jul 17, 2017Updated 8 years ago
• MicPie / clasp

  View on GitHub
  CLASP - Contrastive Language-Aminoacid Sequence Pretraining
  ☆143Sep 17, 2021Updated 4 years ago
• vdavid70619 / TCN

  View on GitHub
  Temporal Context Network for Activity Localization in Videos
  ☆31Oct 25, 2017Updated 8 years ago