Alternatives and similar repositories for linear_layer_as_attention:

Users that are interested in linear_layer_as_attention are comparing it to the libraries listed below

• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆27Updated 9 months ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 3 years ago
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆26Updated 11 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆54Updated 7 months ago
• bethgelab / sober-reasoning
  ☆16Updated this week
• duykhuongnguyen / LASeR-MAB
  Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"
  ☆13Updated 6 months ago
• gregorbachmann / scaling_mlps
  ☆51Updated 10 months ago
• ermongroup / fast_feedforward_computation
  Official code for "Accelerating Feedforward Computation via Parallel Nonlinear Equation Solving", ICML 2021
  ☆27Updated 3 years ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 9 months ago
• VITA-Group / instant_soup
  [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…
  ☆11Updated last year
• yale-nlp / refdpo
  ☆16Updated 8 months ago
• belindal / LaMPP
  Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action
  ☆36Updated 2 years ago
• yikangshen / megablocks
  ☆19Updated 10 months ago
• bdusell / stack-attention
  Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"
  ☆17Updated last year
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆39Updated 4 years ago
• NingMiao / InstaAug
  ☆13Updated 2 years ago
• Eliyas0007 / Pytorch-Intention
  Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention
  ☆11Updated last year
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Updated 2 years ago
• bergen / EdgeTransformer
  ☆22Updated 3 years ago
• LooperXX / ManagerTower
  Code for ACL 2023 Oral Paper: ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning
  ☆11Updated 3 months ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• SriramB-98 / vit-decompose
  ☆22Updated 3 months ago
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated 2 years ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• BYU-PCCL / prompt-compression-contrastive-coding
  Companion repository to "Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models"
  ☆13Updated last year
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆20Updated last year
• HelmholtzAI-FZJ / flex_gen
  ☆17Updated 3 months ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆44Updated 2 years ago