Alternatives and similar repositories for tokenization-repair:

Users that are interested in tokenization-repair are comparing it to the libraries listed below

• lanwuwei / GigaBERT
  Zero-shot Transfer Learning from English to Arabic
  ☆29Updated 2 years ago
• SapienzaNLP / xl-wsd-code
  Code to train and test Word Sense Disambiguation models based on different pretrained transformers.
  ☆13Updated 3 years ago
• jacklxc / StandAloneSpellingCorrection
  Repository for Findings of EMNLP 2020 "Context-aware Stand-alone Neural Spelling Correction"
  ☆18Updated 4 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆32Updated 7 months ago
• ufal / low-resource-gec-wnut2019
  Source code for paper Grammatical Error Correction in Low-Resource Scenarios (W-NUT 2019)
  ☆13Updated 2 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated this week
• flexudy-pipe / sentence-doctor
  Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …
  ☆61Updated 4 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆29Updated 5 months ago
• ad-freiburg / whitespace-correction
  Fast whitespace correction with Transformers
  ☆15Updated 9 months ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆34Updated 4 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated last year
• nusnlp / crosentgec
  Code for cross-sentence grammatical error correction using multilayer convolutional seq2seq models (ACL 2019)
  ☆50Updated 4 years ago
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆22Updated 3 years ago
• codogogo / towerparse
  Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection
  ☆15Updated 3 years ago
• Helsinki-NLP / XED
  XED multilingual emotion datasets
  ☆57Updated last year
• kswamy15 / NLP_Tasks_PyLightning
  Showcasing various NLP Downstream tasks Training with pre-trained Language models using Pytorch Lightning
  ☆13Updated 2 years ago
• nelson-liu / lexical-semantic-recognition
  ☆17Updated last year
• sebastianruder / emnlp2021-multiqa-tutorial
  EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering
  ☆38Updated 3 years ago
• thiborose / gecko-app
  A web application that interfaces two GEC systems. [web instance is down]
  ☆31Updated 5 months ago
• ntunlp / Zero-Shot-Cross-Lingual-NER
  A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.
  ☆46Updated 2 years ago
• lukasgarbas / multiencoder
  Combining encoder-based language models
  ☆11Updated 3 years ago
• thunlp / VERNet
  Source codes of Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction
  ☆43Updated 3 years ago
• ArneBinder / pytorch-ie
  PyTorch-IE: State-of-the-art Information Extraction in PyTorch
  ☆77Updated 2 weeks ago
• cofe-ai / fast-gector
  ☆55Updated last year
• WMT-QE-Task / wmt-qe-2023-data
  ☆9Updated last year
• shrutirij / soft-gazetteers
  Code and data for the paper "Soft Gazetteers for Low-resource Named Entity Recognition"
  ☆19Updated 4 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 4 months ago
• cisnlp / parcoure
  ParCourE - Parallel Corpus Explorer
  ☆12Updated 3 years ago
• esdurmus / Wikilingua
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆85Updated 3 years ago
• todd-cook / ML-You-Can-Use
  Practical ML and NLP with examples.
  ☆34Updated last year