Alternatives and similar repositories for website

Users that are interested in website are comparing it to the libraries listed below

• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆82Updated last year
• ictnlp / PCFG-NAT
  Code for NeurIPS 2023 paper "Non-autoregressive Machine Translation with Probabilistic Context-free Grammar".
  ☆11Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• teelinsan / parallel-decoding
  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
  ☆120Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆68Updated last year
• lucidrains / rvq-vae-gpt
  My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation
  ☆88Updated last year
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆39Updated last year
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆135Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated last year
• lucidrains / n-grammer-pytorch
  Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
  ☆76Updated 2 years ago
• sustcsonglin / mamba-triton
  ☆48Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 2 years ago
• PiotrNawrot / dynamic-pooling
  Efficient Transformers with Dynamic Token Pooling
  ☆64Updated 2 years ago
• microsoft / SparseMixer
  Sparse Backpropagation for Mixture-of-Expert Training
  ☆30Updated last year
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆45Updated 2 years ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆63Updated 3 years ago
• erogol / BlaGPT
  Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…
  ☆82Updated last month
• OpenNLPLab / Tnn
  [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling
  ☆80Updated last year
• microsoft / ResiDual
  ResiDual: Transformer with Dual Residual Connections, https://arxiv.org/abs/2304.14802
  ☆95Updated 2 years ago
• my-yy / s2v_rc
  Speech2Vec Reality Check
  ☆84Updated 2 years ago
• rosinality / imputer-pytorch
  Implementation of Imputer: Sequence Modelling via Imputation and Dynamic Programming in PyTorch
  ☆58Updated 5 years ago
• JonasGeiping / linear_cross_entropy_loss
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆70Updated last year
• igul222 / plaid
  ☆107Updated 2 years ago
• microsoft / ReinMax
  Beyond Straight-Through
  ☆102Updated 2 years ago
• lmgame-org / GRL
  Multi-Turn RL Training System with AgentTrainer for Language Model Game Reinforcement Learning
  ☆45Updated last week
• lsj2408 / URPE
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆32Updated 2 years ago
• Glaciohound / Chimera-ST
  A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021
  ☆48Updated 3 years ago
• allenai / staged-training
  Staged Training for Transformer Language Models
  ☆32Updated 3 years ago