SauravMaheshkar / MLP-Mixer

Related projects: ⓘ

• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆50Updated 2 years ago
• CHARM-Tx / linear_mem_attention_pytorch
  Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch
  ☆12Updated 2 years ago
• gcucurull / jax-gat
  JAX implementation of Graph Attention Networks
  ☆12Updated 2 years ago
• lucidrains / hopular-pytorch
  ☆21Updated this week
• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆14Updated 3 years ago
• AranKomat / Metroplex
  ☆21Updated last year
• lucidrains / mogrifier
  Usable implementation of Mogrifier, a circuit for enhancing LSTMs and potentially other networks, from Deepmind
  ☆13Updated 3 months ago
• lucidrains / deep-linear-network
  A simple implementation of a deep linear Pytorch module
  ☆18Updated 3 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆47Updated 2 years ago
• lucidrains / remixer-pytorch
  Implementation of the Remixer Block from the Remixer paper, in Pytorch
  ☆36Updated 2 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆55Updated 3 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆15Updated 11 months ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• lucidrains / metaformer-gpt
  Implementation of Metaformer, but in an autoregressive manner
  ☆22Updated 2 years ago
• ontocord / tide
  ☆11Updated this week
• jaketae / fnet
  PyTorch implementation of FNet: Mixing Tokens with Fourier transforms
  ☆25Updated 3 years ago
• trisongz / pylines
  Simplifying parsing of large jsonline files in NLP Workflows
  ☆12Updated 2 years ago
• nshepperd / jaxtorch
  A JAX nn library
  ☆20Updated 6 months ago
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆18Updated last year
• lucidrains / saint-pytorch
  ☆12Updated this week
• EleutherAI / exploring-contrastive-topology
  ☆16Updated 2 years ago
• lucidrains / spatial-rmsnorm
  ☆11Updated this week
• lucidrains / einops-exts
  Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
  ☆52Updated last year
• LAION-AI / dataset-spec
  Describe the format of image/text datasets
  ☆11Updated 2 years ago
• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆12Updated last month
• lucidrains / slot-transformer
  ☆21Updated this week
• jenni-ai / T2FW
  Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
  ☆19Updated last year
• lucidrains / hyena-pytorch
  ☆23Updated this week
• lucidrains / local-attention-flax
  Local Attention - Flax module for Jax
  ☆20Updated 3 years ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated 10 months ago