Alternatives and similar repositories for tokenization-repair

Users that are interested in tokenization-repair are comparing it to the libraries listed below

• lanwuwei / GigaBERT
  Zero-shot Transfer Learning from English to Arabic
  ☆30Updated 3 years ago
• flexudy-pipe / sentence-doctor
  Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …
  ☆62Updated 5 years ago
• facebookresearch / muss
  Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".
  ☆99Updated 2 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• writer / fitbert
  Use BERT to Fill in the Blanks
  ☆84Updated 3 years ago
• shrutirij / ocr-post-correction
  ☆141Updated last year
• nelson-liu / lexical-semantic-recognition
  ☆17Updated 2 years ago
• codogogo / towerparse
  Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection
  ☆15Updated 4 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 2 months ago
• Helsinki-NLP / XED
  XED multilingual emotion datasets
  ☆64Updated 2 years ago
• ruathudo / post-ocr-correction
  ☆11Updated 4 years ago
• shijie-wu / neural-transducer
  This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.
  ☆76Updated 2 years ago
• gdamaskinos / unsupervised_topic_segmentation
  ☆105Updated 4 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• dennlinger / TopicalChange
  Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.
  ☆98Updated 2 years ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 3 years ago
• jacklxc / StandAloneSpellingCorrection
  Repository for Findings of EMNLP 2020 "Context-aware Stand-alone Neural Spelling Correction"
  ☆18Updated 4 years ago
• BramVanroy / spacy_conll
  Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…
  ☆80Updated last year
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆86Updated last year
• ricsinaruto / gutenberg-dialog
  Build a dialog dataset from online books in many languages
  ☆76Updated 3 years ago
• helboukkouri / character-bert-pretraining
  Code for pre-training CharacterBERT models (as well as BERT models).
  ☆34Updated 4 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆104Updated 3 years ago
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆15Updated 3 months ago
• esdurmus / Wikilingua
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆96Updated 8 months ago
• ntunlp / Zero-Shot-Cross-Lingual-NER
  A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.
  ☆47Updated 2 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆112Updated last week
• ajitrajasekharan / unsupervised_NER
  Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…
  ☆78Updated 3 years ago
• salesforce / ctrl-sum
  Resources for the "CTRLsum: Towards Generic Controllable Text Summarization" paper
  ☆148Updated 6 months ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 4 years ago