Alternatives and similar repositories for tokenization-repair

Users that are interested in tokenization-repair are comparing it to the libraries listed below

• lanwuwei / GigaBERT
  Zero-shot Transfer Learning from English to Arabic
  ☆30Updated 3 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• bojone / labse
  Language-agnostic BERT Sentence Embedding (LaBSE)
  ☆153Updated 5 years ago
• ajitrajasekharan / unsupervised_NER
  Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…
  ☆78Updated 3 years ago
• flexudy-pipe / sentence-doctor
  Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …
  ☆61Updated 5 years ago
• esdurmus / Wikilingua
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆95Updated 6 months ago
• shrutirij / ocr-post-correction
  ☆139Updated last year
• mingruimingrui / ICU-tokenizer
  ICU based universal language tokenizer
  ☆33Updated 3 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆33Updated last month
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• ntunlp / Zero-Shot-Cross-Lingual-NER
  A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.
  ☆47Updated 2 years ago
• jacklxc / StandAloneSpellingCorrection
  Repository for Findings of EMNLP 2020 "Context-aware Stand-alone Neural Spelling Correction"
  ☆18Updated 4 years ago
• Helsinki-NLP / XED
  XED multilingual emotion datasets
  ☆63Updated 2 years ago
• mawentao277 / CharBERT
  CharBERT: Character-aware Pre-trained Language Model (COLING2020)
  ☆121Updated 4 years ago
• sbu-dsl / chapter-captor
  Code for the EMNLP 2020 paper titled "Chapter Captor: Text Segmentation in Novels"
  ☆30Updated 4 years ago
• ufal / low-resource-gec-wnut2019
  Source code for paper Grammatical Error Correction in Low-Resource Scenarios (W-NUT 2019)
  ☆13Updated 3 years ago
• nelson-liu / lexical-semantic-recognition
  ☆17Updated 2 years ago
• facebookresearch / muss
  Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".
  ☆99Updated 2 years ago
• helboukkouri / character-bert-pretraining
  Code for pre-training CharacterBERT models (as well as BERT models).
  ☆34Updated 4 years ago
• dennlinger / TopicalChange
  Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.
  ☆97Updated 2 years ago
• Unipisa / diaparser
  Direct Attentive Dependency Parser
  ☆54Updated last year
• michiyasunaga / LM-Critic
  [EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction
  ☆120Updated 4 years ago
• codogogo / towerparse
  Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection
  ☆15Updated 4 years ago
• SapienzaNLP / mcl-wic
  Semeval-2021 Multilingual and Cross-lingual Word-in-Context Task
  ☆18Updated 4 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated last week
• davidalami / ConveRT
  Dual Encoders for State-of-the-art Natural Language Processing.
  ☆61Updated 3 years ago
• ruathudo / post-ocr-correction
  ☆11Updated 3 years ago
• plkumjorn / GrASP
  An implementation of GrASP (Shnarch et. al., 2017)
  ☆21Updated 3 years ago
• EdinburghNLP / opus-100-corpus
  ☆94Updated last year
• thunlp / VERNet
  Source codes of Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction
  ☆43Updated 4 years ago