google / cld3

Related projects: ⓘ

• CLD2Owners / cld2
  Compact Language Detector 2
  ☆836Updated 3 years ago
• marian-nmt / marian
  Fast Neural Machine Translation in C++
  ☆1,225Updated last year
• bakwc / JamSpell
  Modern spell checking library - accurate, fast, multi-language
  ☆605Updated 3 weeks ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆717Updated 4 months ago
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆287Updated 3 months ago
• mhagiwara / github-typo-corpus
  GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors
  ☆482Updated 4 years ago
• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆782Updated last month
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆321Updated last month
• explosion / spacy-stanza
  💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy
  ☆724Updated last month
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆732Updated 2 years ago
• bheinzerling / bpemb
  Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
  ☆1,177Updated 6 months ago
• Mimino666 / langdetect
  Port of Google's language-detection library to Python.
  ☆1,709Updated 7 months ago
• barrust / pyspellchecker
  Pure Python Spell Checking http://pyspellchecker.readthedocs.io/en/latest/
  ☆696Updated 6 months ago
• ufal / udpipe
  UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files
  ☆358Updated last week
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆662Updated last year
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆148Updated last year
• mammothb / symspellpy
  Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm…
  ☆791Updated 2 weeks ago
• OpenNMT / Tokenizer
  Fast and customizable text tokenization library with BPE and SentencePiece support
  ☆276Updated 2 weeks ago
• facebookresearch / LASER
  Language-Agnostic SEntence Representations
  ☆3,576Updated 4 months ago
• VKCOM / YouTokenToMe
  Unsupervised text tokenizer focused on computational efficiency
  ☆953Updated 5 months ago
• explosion / sense2vec
  🦆 Contextually-keyed word vectors
  ☆1,617Updated 6 months ago
• grantjenks / python-wordsegment
  English word segmentation, written in pure-Python, and based on a trillion-word corpus.
  ☆364Updated last year
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆961Updated last year
• mjpost / sacrebleu
  Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
  ☆1,040Updated last month
• aboSamoor / polyglot
  Multilingual text (NLP) processing toolkit
  ☆2,307Updated 10 months ago
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆486Updated 3 months ago
• mikemccand / chromium-compact-language-detector
  Automatically exported from code.google.com/p/chromium-compact-language-detector
  ☆160Updated 3 years ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆347Updated 10 months ago
• explosion / spacy-transformers
  🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
  ☆1,339Updated 3 months ago
• saffsd / langid.py
  Stand-alone language identification system
  ☆2,297Updated 4 years ago