google / cld3Links
☆840Updated 2 years ago
Alternatives and similar repositories for cld3
Users that are interested in cld3 are comparing it to the libraries listed below
Sorting:
- Compact Language Detector 2☆866Updated 4 years ago
- Heuristic based boilerplate removal tool☆784Updated 4 months ago
- Fast Neural Machine Translation in C++☆1,347Updated last year
- Modern spell checking library - accurate, fast, multi-language☆641Updated 10 months ago
- Bitextor generates translation memories from multilingual websites☆294Updated 8 months ago
- UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files☆383Updated 7 months ago
- This is a language detection library implemented in plain Java. (aliases: language identification, language guessing)☆757Updated 6 years ago
- Fast and customizable text tokenization library with BPE and SentencePiece support☆311Updated 3 months ago
- Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm…☆833Updated 2 months ago
- 🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.☆863Updated 10 months ago
- Port of Google's language-detection library to Python.☆1,822Updated 4 months ago
- NeuSpell: A Neural Spelling Correction Toolkit☆696Updated last year
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆153Updated 2 years ago
- ☆171Updated 3 months ago
- GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors☆509Updated 5 years ago
- Facebook Low Resource (FLoRes) MT Benchmark☆743Updated last year
- Python port of Moses tokenizer, truecaser and normalizer☆495Updated last year
- 💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy☆736Updated 11 months ago
- All languages stopwords collection☆451Updated last year
- Neural Adaptive Machine Translation that adapts to context and learns from corrections.☆349Updated 3 years ago
- Open neural machine translation models and web services☆707Updated last month
- English word segmentation, written in pure-Python, and based on a trillion-word corpus.☆376Updated 2 years ago
- Training open neural machine translation models☆367Updated 4 months ago
- Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing☆559Updated 8 months ago
- Tools to download and cleanup Common Crawl data☆1,017Updated 2 years ago
- A python module for English lemmatization and inflection.☆268Updated last year
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,215Updated 9 months ago
- Language-Agnostic SEntence Representations☆3,647Updated last year
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆248Updated 2 years ago
- Article extraction benchmark: dataset and evaluation scripts☆318Updated last year