Alternatives and similar repositories for tokenization-repair

Users that are interested in tokenization-repair are comparing it to the libraries listed below

• flexudy-pipe / sentence-doctor
  Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …
  ☆62Updated 5 years ago
• jacklxc / StandAloneSpellingCorrection
  Repository for Findings of EMNLP 2020 "Context-aware Stand-alone Neural Spelling Correction"
  ☆18Updated 4 years ago
• facebookresearch / muss
  Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".
  ☆100Updated 2 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• lanwuwei / GigaBERT
  Zero-shot Transfer Learning from English to Arabic
  ☆30Updated 3 years ago
• Helsinki-NLP / XED
  XED multilingual emotion datasets
  ☆64Updated 2 years ago
• ntunlp / Zero-Shot-Cross-Lingual-NER
  A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.
  ☆47Updated 3 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 3 months ago
• google-research-datasets / C4_200M-synthetic-dataset-for-grammatical-error-correction
  This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…
  ☆161Updated last year
• helboukkouri / character-bert-pretraining
  Code for pre-training CharacterBERT models (as well as BERT models).
  ☆34Updated 4 years ago
• michiyasunaga / LM-Critic
  [EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction
  ☆120Updated 4 years ago
• ufal / low-resource-gec-wnut2019
  Source code for paper Grammatical Error Correction in Low-Resource Scenarios (W-NUT 2019)
  ☆13Updated 3 years ago
• gdamaskinos / unsupervised_topic_segmentation
  ☆105Updated 4 years ago
• shrutirij / ocr-post-correction
  ☆141Updated last year
• ajitrajasekharan / unsupervised_NER
  Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…
  ☆78Updated 3 years ago
• davidalami / ConveRT
  Dual Encoders for State-of-the-art Natural Language Processing.
  ☆61Updated 3 years ago
• writer / fitbert
  Use BERT to Fill in the Blanks
  ☆84Updated 3 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆113Updated this week
• cofe-ai / fast-gector
  ☆61Updated 2 years ago
• ruathudo / post-ocr-correction
  ☆11Updated 4 years ago
• salesforce / ctrl-sum
  Resources for the "CTRLsum: Towards Generic Controllable Text Summarization" paper
  ☆148Updated 7 months ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• shijie-wu / neural-transducer
  This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.
  ☆76Updated 2 years ago
• awasthiabhijeet / PIE
  Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models …
  ☆231Updated 2 years ago
• mawentao277 / CharBERT
  CharBERT: Character-aware Pre-trained Language Model (COLING2020)
  ☆121Updated 4 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 2 months ago
• bltlab / mot
  Multilingual Open Text
  ☆25Updated 7 months ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆105Updated 3 years ago
• grammarly / GMEG
  GMEG
  ☆31Updated last year
• google-research-datasets / clang8
  cLang-8 is a dataset for grammatical error correction.
  ☆110Updated 3 years ago