currentslab / fastlangidLinks
fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-hant)
☆43Updated 3 years ago
Alternatives and similar repositories for fastlangid
Users that are interested in fastlangid are comparing it to the libraries listed below
Sorting:
- A simple neural truecaser written in pytorch and allennlp.☆33Updated last year
- A python true casing utility that restores case information for texts☆88Updated 3 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆34Updated 4 months ago
- An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.☆86Updated 4 years ago
- Source code for the Apple reproduction☆32Updated 4 years ago
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- Rust-based Python wrapper for duckling library in Haskell☆26Updated 5 years ago
- Automatic extraction of edited sentences from text edition histories.☆83Updated 3 years ago
- Bilingual sentence similarity classifier using Tensorflow☆24Updated 6 years ago
- zero-vocab or low-vocab embeddings☆18Updated 3 years ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆155Updated 2 years ago
- Fast edit distance Python extension written in Cython/C++. Supports Levenshtein distance and Damerau Optimal String Alignment (OSA) dista…☆25Updated 7 months ago
- Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.☆51Updated 9 months ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆15Updated last year
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆64Updated 3 years ago
- ☆178Updated 10 months ago
- In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.☆71Updated 3 years ago
- Language detection using Spacy and Fasttext☆57Updated 2 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆160Updated last year
- OpusFilter - Parallel corpus processing toolkit☆115Updated last week
- A tiny BERT for low-resource monolingual models☆31Updated last month
- Sentence transformers models for SpaCy☆109Updated 2 years ago
- ☆30Updated 3 years ago
- ☆32Updated 4 years ago
- Corpus preprocessing☆99Updated last year
- BERT models for many languages created from Wikipedia texts☆33Updated 5 years ago
- General-Purpose Neural Networks for Sentence Boundary Detection☆73Updated 2 years ago
- Lightning Fast Language Prediction 🚀☆167Updated 5 months ago
- Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection☆15Updated 4 years ago
- List of corpora annotated for coreference for different languages☆17Updated last year