Alternatives and similar repositories for transformer-smaller-training-vocab

Users that are interested in transformer-smaller-training-vocab are comparing it to the libraries listed below

• stephantul / piecelearn
  Learning BPE embeddings by first learning a segmentation model and then training word2vec
  ☆19Updated 2 years ago
• ltgoslo / simple_elmo_training
  Minimal code to train ELMo models in recent versions of TensorFlow
  ☆14Updated 2 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 4 years ago
• UniversalNER / UniversalNER
  ☆27Updated 9 months ago
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated 11 months ago
• tigerchen52 / GLADIS
  GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)
  ☆18Updated last year
• ChenghaoMou / embeddings
  zero-vocab or low-vocab embeddings
  ☆18Updated 3 years ago
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆69Updated last year
• wietsedv / gpt2-recycle
  As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)
  ☆48Updated 4 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• BramVanroy / spacy_conll
  Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…
  ☆81Updated last year
• ArneBinder / pytorch-ie
  PyTorch-IE: State-of-the-art Information Extraction in PyTorch
  ☆77Updated 2 months ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆85Updated last year
• ivanmontero / autobot
  Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'
  ☆17Updated 3 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆105Updated 3 years ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆27Updated 11 months ago
• pmbaumgartner / setfit
  ☆43Updated 2 years ago
• KennethEnevoldsen / augmenty
  Augmenty is an augmentation library based on spaCy for augmenting texts.
  ☆156Updated last year
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated last year
• LightTag / sequence-labeling-with-transformers
  Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models
  ☆64Updated 2 years ago
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆85Updated 2 weeks ago
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated 8 months ago
• yahshibu / nested-ner-tacl2020-flair
  Implementation of Nested Named Entity Recognition using Flair
  ☆24Updated 4 years ago
• jouniluoma / bert-ner-cmv
  ☆13Updated 3 years ago
• PyThaiNLP / MultiEL
  Multilingual Entity Linking model by BELA model
  ☆12Updated 2 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• MaksymDel / allennlp-light
  allennlp-light is a port of AllenNLP's core modules and nn portions into a standalone package with minimum dependencies
  ☆55Updated 3 years ago
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆21Updated last year
• lukasgarbas / can-we-tune-together
  Combining encoder-based language models
  ☆11Updated 4 years ago
• machamp-nlp / machamp
  Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/
  ☆87Updated 6 months ago