Alternatives and similar repositories for dynamic-pooling

Users that are interested in dynamic-pooling are comparing it to the libraries listed below

• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆138Updated last year
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆114Updated 2 years ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆69Updated 2 years ago
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆143Updated 3 years ago
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆77Updated 2 years ago
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆82Updated last year
• rabeehk / compacter
  ☆130Updated 3 years ago
• deep-spin / infinite-former
  ☆67Updated last year
• chijames / KERPLE
  ☆20Updated 3 years ago
• microsoft / AdaMix
  This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…
  ☆136Updated 2 years ago
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆34Updated 6 months ago
• bigscience-workshop / architecture-objective
  ☆98Updated 2 years ago
• Shark-NLP / CAB
  ☆31Updated 2 years ago
• cliang1453 / SAGE
  No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)
  ☆29Updated 3 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆42Updated last year
• allenai / staged-training
  Staged Training for Transformer Language Models
  ☆33Updated 3 years ago
• ghrua / NgramRes
  ☆22Updated 3 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆54Updated 4 years ago
• SimengSun / ChapterBreak
  ☆11Updated last year
• cambridgeltl / composable-sft
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆75Updated last year
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 3 years ago
• sustcsonglin / mamba-triton
  ☆51Updated last year
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆116Updated last year
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 2 years ago
• HazyResearch / prefix-linear-attention
  ☆57Updated last year
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆66Updated last year
• google-deepmind / emergent_in_context_learning
  ☆85Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated 2 years ago
• hadasah / btm
  ☆76Updated last year