google / cld3Links
☆842Updated 2 years ago
Alternatives and similar repositories for cld3
Users that are interested in cld3 are comparing it to the libraries listed below
Sorting:
- Compact Language Detector 2☆870Updated 4 years ago
- Modern spell checking library - accurate, fast, multi-language☆643Updated 11 months ago
- Heuristic based boilerplate removal tool☆788Updated 5 months ago
- Bitextor generates translation memories from multilingual websites☆294Updated 8 months ago
- Fast Neural Machine Translation in C++☆1,360Updated last year
- Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm…☆836Updated 3 months ago
- GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors☆510Updated 5 years ago
- Neural Adaptive Machine Translation that adapts to context and learns from corrections.☆349Updated 3 years ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- 🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.☆864Updated 11 months ago
- NeuSpell: A Neural Spelling Correction Toolkit☆696Updated 2 years ago
- Training open neural machine translation models☆369Updated 4 months ago
- All languages stopwords collection☆451Updated last year
- Sentence aligner☆116Updated 4 years ago
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,216Updated 10 months ago
- Fast and customizable text tokenization library with BPE and SentencePiece support☆313Updated 3 months ago
- ☆172Updated 4 months ago
- UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files☆386Updated 2 weeks ago
- Article extraction benchmark: dataset and evaluation scripts☆320Updated last year
- English word segmentation, written in pure-Python, and based on a trillion-word corpus.☆376Updated 2 years ago
- Snowball compiler and stemming algorithms☆804Updated this week
- Tools to download and cleanup Common Crawl data☆1,022Updated 2 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆496Updated last year
- ☆515Updated last year
- Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing☆559Updated 9 months ago
- A python module for English lemmatization and inflection.☆268Updated last year
- Machine-readable lists of lemma-token pairs in 23 languages.☆342Updated 3 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆373Updated last year
- Python bindings for cld3☆27Updated 2 years ago
- Unsupervised text tokenizer focused on computational efficiency☆972Updated last year