Alternatives and similar repositories for Hrrformer

Users that are interested in Hrrformer are comparing it to the libraries listed below

• kazuki-irie / kv-memory-brain
  Official Code Repository for the paper "Key-value memory in the brain"
  ☆26Updated 3 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• FutureComputing4AI / Learning-with-Holographic-Reduced-Representations
  ☆29Updated 3 years ago
• IDSIA / rtrl-elstm
  Official repository for the paper "Exploring the Promise and Limits of Real-Time Recurrent Learning" (ICLR 2024)
  ☆10Updated last year
• shikaiqiu / compute-better-spent
  ☆53Updated 8 months ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆58Updated last year
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆16Updated last year
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆27Updated 2 years ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• ExtensityAI / benchmark
  Evaluation of neuro-symbolic engines
  ☆35Updated 10 months ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆36Updated last year
• AndPotap / einsum-search
  ☆32Updated 8 months ago
• HazyResearch / prefix-linear-attention
  ☆54Updated 10 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• samblouir / birdie
  ☆13Updated last week
• jopetty / word-problem
  Experiments on the impact of depth in transformers and SSMs.
  ☆30Updated 7 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆51Updated 4 months ago
• sjelassi / transformers_ssm_copy
  ☆31Updated last year
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆66Updated 2 years ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆35Updated last year
• OSU-NLP-Group / reversal-curse-binding
  ☆23Updated 2 months ago
• Doraemonzzz / hgru2-pytorch
  ☆23Updated 8 months ago
• FieteLab / MESH
  ☆13Updated 2 years ago
• ssokota / mec
  Code for minimum-entropy coupling.
  ☆32Updated 11 months ago
• sustcsonglin / mamba-triton
  ☆46Updated last year
• yikangshen / megablocks
  ☆20Updated last year
• automl / unlocking_state_tracking
  Expanding linear RNN state-transition matrix eigenvalues to include negatives improves state-tracking tasks and language modeling without…
  ☆15Updated 2 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 4 months ago
• fjzzq2002 / pizza
  Code repository for "The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks"
  ☆16Updated last year