Alternatives and similar repositories for alibi

Users that are interested in alibi are comparing it to the libraries listed below

• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 3 years ago
• ChristophReich1996 / HyperMixer
  PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].
  ☆17Updated 3 years ago
• microsoft / ResiDual
  ResiDual: Transformer with Dual Residual Connections, https://arxiv.org/abs/2304.14802
  ☆95Updated 2 years ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆48Updated 11 months ago
• maum-ai / pnlp-mixer
  Unofficial PyTorch Implementation for pNLP-Mixer: an Efficient all-MLP Architecture for Language (https://arxiv.org/abs/2202.04350)
  ☆63Updated 3 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆83Updated 6 months ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆39Updated 3 years ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆121Updated 11 months ago
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆106Updated 3 weeks ago
• lucidrains / fast-transformer-pytorch
  Implementation of Fast Transformer in Pytorch
  ☆176Updated 4 years ago
• lucidrains / hourglass-transformer-pytorch
  Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
  ☆94Updated 3 years ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆78Updated last year
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆44Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆75Updated 2 years ago
• lucidrains / memory-compressed-attention
  Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"
  ☆70Updated 2 years ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆53Updated 5 months ago
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated 2 years ago
• crypdick / timm-lr-scheduler-explorer
  A dashboard for exploring timm learning rate schedulers
  ☆19Updated 9 months ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆58Updated last year
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆22Updated last year
• lucidrains / compositional-attention-pytorch
  Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…
  ☆51Updated 3 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆50Updated 3 years ago
• lucidrains / metaformer-gpt
  Implementation of Metaformer, but in an autoregressive manner
  ☆27Updated 3 years ago
• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆38Updated 3 years ago
• lsj2408 / URPE
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆33Updated 2 years ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆111Updated 8 months ago
• lucidrains / RQ-Transformer
  Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"
  ☆120Updated 3 years ago
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆120Updated 4 years ago
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆91Updated last year
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆88Updated 2 years ago