Alternatives and similar repositories for nanoTransNormer

Users that are interested in nanoTransNormer are comparing it to the libraries listed below

• glassroom / heinsen_attention

  View on GitHub
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Jun 6, 2024Updated last year
• robert-lieck / RBN

  View on GitHub
  Recursive Bayesian Networks
  ☆11May 11, 2025Updated 9 months ago
• recursal / RADLADS-paper

  View on GitHub
  RADLADS training code
  ☆36May 7, 2025Updated 9 months ago
• OpenNLPLab / ETSC-Exact-Toeplitz-to-SSM-Conversion

  View on GitHub
  [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…
  ☆14Oct 17, 2023Updated 2 years ago
• AlirezaMorsali / MLP-Attention

  View on GitHub
  ☆16Dec 19, 2024Updated last year
• zsLin177 / SRL-as-GP

  View on GitHub
  ☆18Mar 10, 2023Updated 2 years ago
• nanowell / Q-Sparse-LLM

  View on GitHub
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Aug 14, 2024Updated last year
• TRI-ML / linear_open_lm

  View on GitHub
  A repository for research on medium sized language models.
  ☆77May 23, 2024Updated last year
• Shark-NLP / CAB

  View on GitHub
  ☆31Jul 2, 2023Updated 2 years ago
• hyp1231 / ICLR2023-OpenReviewData

  View on GitHub
  Crawl & visualize ICLR papers and reviews.
  ☆18Nov 5, 2022Updated 3 years ago
• rycolab / spanningtrees

  View on GitHub
  Code Repository for "Please Mind the Root: Decoding Arborescences for Dependency Parsing" and "On Finding the K-best Non-projective Depen…
  ☆20Dec 12, 2022Updated 3 years ago
• yikangshen / megablocks

  View on GitHub
  ☆20May 30, 2024Updated last year
• OpenNLPLab / HGRN2

  View on GitHub
  HGRN2: Gated Linear RNNs with State Expansion
  ☆56Aug 20, 2024Updated last year
• berlino / seq_icl

  View on GitHub
  ☆53May 20, 2024Updated last year
• subho406 / agalite

  View on GitHub
  AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning (Published in TMLR)
  ☆23Oct 15, 2024Updated last year
• ethansmith2000 / TransformerExperiments

  View on GitHub
  ☆19Dec 4, 2025Updated 2 months ago
• maximzubkov / fft-scan

  View on GitHub
  Efficient PScan implementation in PyTorch
  ☆17Jan 2, 2024Updated 2 years ago
• sustcsonglin / second-order-neural-dmv

  View on GitHub
  source code of COLING2020 "Second-Order Unsupervised Neural Dependency Parsing"
  ☆16Oct 24, 2022Updated 3 years ago
• sustcsonglin / span-based-dependency-parsing

  View on GitHub
  Source code of ACL2022 "Headed-Span-Based Projective Dependency Parsing" and "Combining (second-order) graph-based and headed-span-based …
  ☆16Jan 12, 2023Updated 3 years ago
• smonsays / hypernetwork-attention

  View on GitHub
  Official code for the paper "Attention as a Hypernetwork"
  ☆47Jun 22, 2024Updated last year
• emalach / LinearLM

  View on GitHub
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆21Jul 29, 2024Updated last year
• johanwind / wind_rwkv

  View on GitHub
  ☆27Jul 28, 2025Updated 6 months ago
• howard-hou / RWKV-X

  View on GitHub
  RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…
  ☆54Jan 12, 2026Updated last month
• Aleph-Alpha-Research / NeurIPS-WANT-submission-efficient-parallelization-layouts

  View on GitHub
  ☆22Dec 15, 2023Updated 2 years ago
• sanagno / adaptively_sparse_attention

  View on GitHub
  ☆22Jul 7, 2023Updated 2 years ago
• mcoavoux / mtg

  View on GitHub
  Statistical discontinuous constituent parsing
  ☆11Feb 15, 2018Updated 7 years ago
• Doraemonzzz / hgru2-pytorch

  View on GitHub
  ☆24Sep 25, 2024Updated last year
• codefuse-ai / rodimus

  View on GitHub
  ☆177Apr 23, 2025Updated 9 months ago
• LouChao98 / neural_based_dmv

  View on GitHub
  ☆22Apr 14, 2020Updated 5 years ago
• Noahs-ARK / PaLM

  View on GitHub
  PyTorch implementation for PaLM: A Hybrid Parser and Language Model.
  ☆10Jan 7, 2020Updated 6 years ago
• rycolab / aflt-f2023

  View on GitHub
  Advanced Formal Language Theory (263-5352-00L; Frühjahr 2023)
  ☆10Feb 21, 2023Updated 2 years ago
• Ryu1845 / hyena-jax

  View on GitHub
  Implementation of Hyena Hierarchy in JAX
  ☆10Apr 30, 2023Updated 2 years ago
• deep-spin / spectra-rationalization

  View on GitHub
  Repository for SPECTRA: Sparse Structured Text Rationalization, accepted at EMNLP 2021 main conference.
  ☆10Feb 14, 2024Updated 2 years ago
• da03 / criticize_text_generation

  View on GitHub
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Mar 18, 2023Updated 2 years ago
• VPeterV / RankSpace-Models

  View on GitHub
  source code for NAACL2022 main conference "Dynamic Programming in Rank Space: Scaling Structured Inference with Low-Rank HMMs and PCFGs"
  ☆10Sep 26, 2022Updated 3 years ago
• iesl / s-diora

  View on GitHub
  ☆12Jan 29, 2021Updated 5 years ago
• ntunlp / ptrnet-depparser

  View on GitHub
  ☆11Oct 13, 2019Updated 6 years ago
• NP-NET-research / Recursive-Semi-Markov-Model

  View on GitHub
  Source code for "N-ary Constituent Tree Parsing with Recursive Semi-Markov Model" published at ACL 2021
  ☆10May 27, 2021Updated 4 years ago
• WinnieHAN / structure_adv

  View on GitHub
  ☆10Oct 28, 2020Updated 5 years ago