saffsd / polyglot
Polyglot is a language identifier for detecting text documents containing text written in more than one language, and for identifying the languages therein.
☆32Updated 8 years ago
Related projects ⓘ
Alternatives and complementary repositories for polyglot
- Fast Word Clustering Software☆74Updated 3 months ago
- Text processing library for sentiment analysis and related tasks☆27Updated 6 years ago
- framework for doing NER and other types of entity recognition, in Python☆68Updated 2 years ago
- Fast supervised sentence boundary detection using the averaged perceptron☆90Updated 5 years ago
- Hierarchical phrase-based machine translation system☆32Updated 9 years ago
- A tool for text normalisation via character-level machine translation☆13Updated 4 years ago
- A natural language processing tool for automatically detecting quotations in text.☆15Updated 2 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆41Updated 5 years ago
- 🚀GUI for training spaCy models☆53Updated 3 years ago
- Labeled examples from wiki dumps in Python☆68Updated 8 years ago
- ☆54Updated 9 years ago
- A way to do annotations for NER. TALEN: Tool for Annotation of Low-resource ENtities☆112Updated 2 years ago
- Natural language processing (NLP) newsletter right on GitHub☆60Updated 4 years ago
- Unsupervised method for extracting quotation-speaker pairs from large news corpora.☆28Updated 6 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆50Updated 4 years ago
- CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems☆57Updated 7 months ago
- spaCy-to-naf converter☆21Updated 5 months ago
- Regex like pattern tree matching but on sentence's tree instead of Strings☆42Updated 6 years ago
- Language detection extension for spaCy 2.0+☆111Updated 5 years ago
- Socially-Equitable Language Identification☆78Updated last year
- Temporal Expression Recognition and Normalisation in Python☆78Updated 8 years ago
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Updated 8 years ago
- ADEL is a robust and efficient entity linking framework that is adaptive to text genres and language, entity types for the classification…☆17Updated 4 years ago
- Normalizes lexically ill-formed text to its most likely clean text, e.g. "c u thr 2nite!" -> "see you there tonight!".☆63Updated 9 years ago
- An example of how to use spaCy for extremely large files without running into memory issues☆36Updated 2 years ago
- Code for EMNLP 2016 paper: Morphological Priors for Probabilistic Word Embeddings☆52Updated 7 years ago
- A visualisation tool for Spacy using Hierplane.☆65Updated last year
- Language Tool style grammar handling with spaCy 2.0☆42Updated 6 years ago
- Implementation of a simple frame identification approach (SimpleFrameId) described in the paper "Out-of-domain FrameNet Semantic Role Lab…☆15Updated 7 years ago