google / cld3

Related projects ⓘ

Alternatives and complementary repositories for cld3

• CLD2Owners / cld2
  Compact Language Detector 2
  ☆845Updated 3 years ago
• marian-nmt / marian
  Fast Neural Machine Translation in C++
  ☆1,255Updated last year
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆291Updated last week
• Elizafox / cld3
  Python bindings for cld3
  ☆27Updated last year
• mammothb / symspellpy
  Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm…
  ☆802Updated this week
• microsoft / BlingFire
  A lightning fast Finite State machine and REgular expression manipulation library.
  ☆1,835Updated last year
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆149Updated last year
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆738Updated 2 years ago
• aboSamoor / pycld2
  ☆165Updated 5 months ago
• bheinzerling / bpemb
  Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
  ☆1,187Updated last month
• babylonhealth / fastText_multilingual
  Multilingual word vectors in 78 languages
  ☆1,197Updated last year
• OpenNMT / Tokenizer
  Fast and customizable text tokenization library with BPE and SentencePiece support
  ☆284Updated 2 months ago
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆336Updated 3 months ago
• mhagiwara / github-typo-corpus
  GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors
  ☆491Updated 4 years ago
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆488Updated 5 months ago
• saffsd / langid.py
  Stand-alone language identification system
  ☆2,323Updated 4 years ago
• mikemccand / chromium-compact-language-detector
  Automatically exported from code.google.com/p/chromium-compact-language-detector
  ☆160Updated 4 years ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆150Updated 5 months ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆729Updated 6 months ago
• explosion / spacy-stanza
  💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy
  ☆725Updated 3 months ago
• VKCOM / YouTokenToMe
  Unsupervised text tokenizer focused on computational efficiency
  ☆959Updated 7 months ago
• Mimino666 / langdetect
  Port of Google's language-detection library to Python.
  ☆1,728Updated 10 months ago
• glample / fastBPE
  Fast BPE
  ☆656Updated 5 months ago
• shuyo / language-detection
  This is a language detection library implemented in plain Java. (aliases: language identification, language guessing)
  ☆733Updated 5 years ago
• bakwc / JamSpell
  Modern spell checking library - accurate, fast, multi-language
  ☆613Updated 2 months ago
• ufal / udpipe
  UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files
  ☆364Updated last week
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆624Updated last month
• EdinburghNLP / nematus
  Open-Source Neural Machine Translation in Tensorflow
  ☆797Updated last year
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆972Updated last year
• OpenNMT / OpenNMT-tf
  Neural machine translation and sequence learning using TensorFlow
  ☆1,458Updated last year