Alternatives and similar repositories for length-adaptive-transformer

Users that are interested in length-adaptive-transformer are comparing it to the libraries listed below

• IBM / PoWER-BERT

  View on GitHub
  Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…
  ☆62Sep 17, 2025Updated 4 months ago
• clovaai / subword-qac

  View on GitHub
  Subword Language Model for Query Auto-Completion
  ☆67Sep 5, 2019Updated 6 years ago
• clovaai / som-dst

  View on GitHub
  SOM-DST: Efficient Dialogue State Tracking by Selectively Overwriting Memory (ACL 2020)
  ☆153Jul 25, 2024Updated last year
• facebookresearch / unlikelihood_training

  View on GitHub
  Neural Text Generation with Unlikelihood Training
  ☆310Aug 31, 2021Updated 4 years ago
• lucidrains / token-shift-gpt

  View on GitHub
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆49Jan 27, 2022Updated 4 years ago
• gonglinyuan / StackingBERT

  View on GitHub
  Source code for "Efficient Training of BERT by Progressively Stacking"
  ☆113Jul 3, 2019Updated 6 years ago
• alexa / bort

  View on GitHub
  Repository for the paper "Optimal Subarchitecture Extraction for BERT"
  ☆470Jun 22, 2022Updated 3 years ago
• easonnie / mlp-vil

  View on GitHub
  MLPs for Vision and Langauge Modeling (Coming Soon)
  ☆27Dec 9, 2021Updated 4 years ago
• jason9693 / FROZEN

  View on GitHub
  ☆14May 3, 2022Updated 3 years ago
• facebookresearch / SentAugment

  View on GitHub
  SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…
  ☆359Feb 22, 2022Updated 3 years ago
• korean-named-entity / konec

  View on GitHub
  Korean Named Entity Corpus
  ☆25May 12, 2023Updated 2 years ago
• Huffon / nlp-startups

  View on GitHub
  국내 자연어 처리 기술을 연구 및 개발하는 스타트업 목록
  ☆165May 10, 2020Updated 5 years ago
• zinengtang / VidLanKD

  View on GitHub
  Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))
  ☆56Feb 6, 2023Updated 3 years ago
• Beomi / transformers-language-modeling

  View on GitHub
  Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3
  ☆23May 20, 2021Updated 4 years ago
• ofirpress / shortformer

  View on GitHub
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Jul 26, 2021Updated 4 years ago
• laiguokun / Funnel-Transformer

  View on GitHub
  ☆221Jun 8, 2020Updated 5 years ago
• clovaai / minimal-rnr-qa

  View on GitHub
  [NAACL 2021] Designing a Minimal Retrieve-and-Read System for Open-Domain Question Answering
  ☆36Apr 20, 2021Updated 4 years ago
• seominjoon / piqa

  View on GitHub
  Phrase-Indexed Question Answering (PIQA)
  ☆94Apr 27, 2019Updated 6 years ago
• cambridgeltl / parameter-factorization

  View on GitHub
  Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer
  ☆39Sep 22, 2020Updated 5 years ago
• faviq / faviq

  View on GitHub
  FaVIQ: Fact Verification from Information-seeking Questions
  ☆43Nov 23, 2022Updated 3 years ago
• facebookresearch / multihop_dense_retrieval

  View on GitHub
  Multi-hop dense retrieval for question answering
  ☆218Oct 12, 2021Updated 4 years ago
• jeongukjae / korean-wikipedia-corpus

  View on GitHub
  문장단위로 분절된 한국어 위키피디아 코퍼스. Releases에서 다운로드 받거나 tfds-korean으로 사용해주세요.
  ☆24Sep 6, 2023Updated 2 years ago
• seujung / t5-summarization

  View on GitHub
  ☆25Oct 28, 2020Updated 5 years ago
• nng555 / ssmba

  View on GitHub
  ☆62Apr 19, 2022Updated 3 years ago
• korean-named-entity / konne

  View on GitHub
  Korean Nested Named Entity Corpus
  ☆20May 13, 2023Updated 2 years ago
• allenai / tpu_pretrain

  View on GitHub
  LM Pretraining with PyTorch/TPU
  ☆137Oct 24, 2019Updated 6 years ago
• LiyuanLucasLiu / Transformer-Clinic

  View on GitHub
  Understanding the Difficulty of Training Transformers
  ☆332May 31, 2022Updated 3 years ago
• airsplay / vokenization

  View on GitHub
  PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"
  ☆192Mar 8, 2021Updated 4 years ago
• enlipleai / kor_pretrain_LM

  View on GitHub
  https://ailabs.enliple.com/
  ☆105Feb 25, 2021Updated 4 years ago
• lovit / huggingface_konlpy

  View on GitHub
  Training Transformers of Huggingface with KoNLPy
  ☆68Aug 28, 2020Updated 5 years ago
• CHARM-Tx / linear_mem_attention_pytorch

  View on GitHub
  Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch
  ☆12Jan 16, 2022Updated 4 years ago
• cheneydon / efficient-bert

  View on GitHub
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆33Jun 14, 2023Updated 2 years ago
• Optimization-AI / SogCLR

  View on GitHub
  Stochastic Optimization for Global Contrastive Learning without Large Mini-batches
  ☆20Mar 31, 2023Updated 2 years ago
• lih0905 / WSD_kor

  View on GitHub
  한국어 어휘 의미 분석 모델
  ☆21Apr 4, 2022Updated 3 years ago
• ClashLuke / PerfTorch

  View on GitHub
  High performance pytorch modules
  ☆18Jan 14, 2023Updated 3 years ago
• mbforbes / physical-commonsense

  View on GitHub
  Do Neural Language Representations Learn Physical Commonsense?
  ☆22Dec 28, 2021Updated 4 years ago
• mlpc-ucsd / BERT_Convolutions

  View on GitHub
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Jul 13, 2022Updated 3 years ago
• YongWookHa / kor-text-preprocess

  View on GitHub
  Korean text data preprocess toolkit for NLP
  ☆18Jun 11, 2019Updated 6 years ago
• allenai / longformer

  View on GitHub
  Longformer: The Long-Document Transformer
  ☆2,186Feb 8, 2023Updated 3 years ago