Alternatives and similar repositories for cld3:

Users that are interested in cld3 are comparing it to the libraries listed below

• CLD2Owners / cld2
  Compact Language Detector 2
  ☆858Updated 3 years ago
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆292Updated 5 months ago
• bheinzerling / bpemb
  Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
  ☆1,211Updated 6 months ago
• OpenNMT / Tokenizer
  Fast and customizable text tokenization library with BPE and SentencePiece support
  ☆302Updated 7 months ago
• bakwc / JamSpell
  Modern spell checking library - accurate, fast, multi-language
  ☆634Updated 7 months ago
• marian-nmt / marian
  Fast Neural Machine Translation in C++
  ☆1,315Updated last year
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆751Updated 2 years ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆765Updated last month
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆493Updated 10 months ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆151Updated last year
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆680Updated 4 months ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆999Updated last year
• VKCOM / YouTokenToMe
  Unsupervised text tokenizer focused on computational efficiency
  ☆965Updated last year
• mhagiwara / github-typo-corpus
  GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors
  ☆505Updated 5 years ago
• aboSamoor / pycld2
  ☆169Updated 3 weeks ago
• ufal / udpipe
  UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files
  ☆378Updated 4 months ago
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆357Updated last month
• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆845Updated 7 months ago
• mammothb / symspellpy
  Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm…
  ☆824Updated 3 weeks ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆157Updated 10 months ago
• facebookresearch / LASER
  Language-Agnostic SEntence Representations
  ☆3,632Updated 11 months ago
• mikemccand / chromium-compact-language-detector
  Automatically exported from code.google.com/p/chromium-compact-language-detector
  ☆161Updated 4 years ago
• Elizafox / cld3
  Python bindings for cld3
  ☆27Updated last year
• explosion / floret
  🌸 fastText + Bloom embeddings for compact, full-coverage vectors with spaCy
  ☆310Updated last year
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆346Updated 3 years ago
• google-research / byt5
  ☆501Updated last year
• diasks2 / pragmatic_segmenter
  Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
  ☆566Updated 8 months ago
• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆726Updated last year
• danielvarga / hunalign
  Sentence aligner
  ☆112Updated 3 years ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆361Updated last year