google / cld3
☆807Updated last year
Alternatives and similar repositories for cld3:
Users that are interested in cld3 are comparing it to the libraries listed below
- Compact Language Detector 2☆850Updated 3 years ago
- Fast Neural Machine Translation in C++☆1,286Updated last year
- 🦆 Contextually-keyed word vectors☆1,638Updated 11 months ago
- Heuristic based boilerplate removal tool☆747Updated 9 months ago
- Tools to download and cleanup Common Crawl data☆983Updated last year
- The most accurate natural language detection library for Python, suitable for short text and mixed-language text☆1,241Updated last week
- Article extraction benchmark: dataset and evaluation scripts☆301Updated 9 months ago
- A python module for English lemmatization and inflection.☆265Updated last year
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,194Updated 4 months ago
- Python port of Moses tokenizer, truecaser and normalizer☆489Updated 8 months ago
- Modern spell checking library - accurate, fast, multi-language☆624Updated 5 months ago
- Simple, fast unsupervised word aligner☆744Updated 2 years ago
- 💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy☆730Updated 6 months ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆150Updated last year
- Port of Google's language-detection library to Python.☆1,752Updated last year
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,101Updated last month
- Stand-alone language identification system☆2,354Updated 5 years ago
- UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files☆375Updated 3 months ago
- GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors☆498Updated 5 years ago
- Bitextor generates translation memories from multilingual websites☆293Updated 3 months ago
- Training open neural machine translation models☆351Updated 6 months ago
- NeuSpell: A Neural Spelling Correction Toolkit☆684Updated last year
- Python bindings for cld3☆27Updated last year
- Fast BPE☆662Updated 8 months ago
- ☆168Updated 8 months ago
- Open neural machine translation models and web services☆655Updated 2 months ago
- 🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.☆831Updated 6 months ago
- ☆494Updated last year
- Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing☆557Updated 3 months ago
- ☆1,263Updated 2 years ago