currentslab / fastlangidLinks
fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-hant)
☆41Updated 2 years ago
Alternatives and similar repositories for fastlangid
Users that are interested in fastlangid are comparing it to the libraries listed below
Sorting:
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆33Updated last month
- A simple neural truecaser written in pytorch and allennlp.☆33Updated last year
- Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection☆15Updated 4 years ago
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.☆86Updated 4 years ago
- Automatic extraction of edited sentences from text edition histories.☆83Updated 3 years ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- BERT models for many languages created from Wikipedia texts☆33Updated 5 years ago
- OpusFilter - Parallel corpus processing toolkit☆110Updated last week
- A tiny BERT for low-resource monolingual models☆31Updated last week
- List of corpora annotated for coreference for different languages☆17Updated last year
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆64Updated 2 years ago
- ☆76Updated last month
- Pre-trained models and code and data to train and use models from "Pushing the Limits of Paraphrastic Sentence Embeddings with Millions o…☆103Updated last year
- ☆174Updated 6 months ago
- In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.☆71Updated 2 years ago
- ☆33Updated 4 years ago
- Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …☆61Updated 5 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆254Updated 2 years ago
- Bilingual sentence similarity classifier using Tensorflow☆24Updated 6 years ago
- SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP☆14Updated 4 years ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆82Updated last year
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆15Updated last year
- zero-vocab or low-vocab embeddings☆18Updated 3 years ago
- A web application tagging and retrieval of arguments in text☆29Updated 2 years ago
- Lightning Fast Language Prediction 🚀☆167Updated last month
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆45Updated last year
- Unofficial implementation of Adaptive Input in PyTorch☆12Updated 6 years ago
- Efficient Low-Memory Aligner☆146Updated 8 months ago