Alternatives and similar repositories for tokenization-repair

Users that are interested in tokenization-repair are comparing it to the libraries listed below

• lanwuwei / GigaBERT
  Zero-shot Transfer Learning from English to Arabic
  ☆30Updated 3 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• ruathudo / post-ocr-correction
  ☆11Updated 4 years ago
• Helsinki-NLP / XED
  XED multilingual emotion datasets
  ☆64Updated 2 years ago
• facebookresearch / muss
  Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".
  ☆99Updated 2 years ago
• flexudy-pipe / sentence-doctor
  Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …
  ☆62Updated 5 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 4 months ago
• writer / fitbert
  Use BERT to Fill in the Blanks
  ☆84Updated 4 years ago
• jacklxc / StandAloneSpellingCorrection
  Repository for Findings of EMNLP 2020 "Context-aware Stand-alone Neural Spelling Correction"
  ☆18Updated 5 years ago
• shrutirij / ocr-post-correction
  ☆141Updated last year
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆115Updated last week
• esdurmus / Wikilingua
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆99Updated 10 months ago
• ntunlp / Zero-Shot-Cross-Lingual-NER
  A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.
  ☆47Updated 3 years ago
• nelson-liu / lexical-semantic-recognition
  ☆18Updated 2 years ago
• codogogo / towerparse
  Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection
  ☆15Updated 4 years ago
• todd-cook / ML-You-Can-Use
  Practical ML and NLP with examples.
  ☆35Updated 2 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆105Updated 3 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 4 years ago
• davidalami / ConveRT
  Dual Encoders for State-of-the-art Natural Language Processing.
  ☆60Updated 3 years ago
• ufal / low-resource-gec-wnut2019
  Source code for paper Grammatical Error Correction in Low-Resource Scenarios (W-NUT 2019)
  ☆13Updated 3 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• dennlinger / TopicalChange
  Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.
  ☆98Updated 2 years ago
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆17Updated 5 months ago
• bltlab / mot
  Multilingual Open Text
  ☆25Updated 8 months ago
• ajitrajasekharan / unsupervised_NER
  Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…
  ☆78Updated 3 years ago
• BramVanroy / spacy_conll
  Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…
  ☆81Updated last year
• bojone / labse
  Language-agnostic BERT Sentence Embedding (LaBSE)
  ☆153Updated 5 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆87Updated last year
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• epfml / Bi-Sent2Vec
  Robust Cross-lingual Embeddings from Parallel Sentences
  ☆22Updated 5 years ago