saffsd / polyglot
Polyglot is a language identifier for detecting text documents containing text written in more than one language, and for identifying the languages therein.
☆33Updated 8 years ago
Alternatives and similar repositories for polyglot:
Users that are interested in polyglot are comparing it to the libraries listed below
- ☆54Updated 9 years ago
- Fast Word Clustering Software☆78Updated 3 weeks ago
- A python wrapper for Semaphore, a Shallow Semantic Parser that identifies roles in a text.☆12Updated 11 years ago
- framework for doing NER and other types of entity recognition, in Python☆68Updated 2 years ago
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Updated 8 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆41Updated 5 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆51Updated 4 years ago
- Temporal Expression Recognition and Normalisation in Python☆78Updated 9 years ago
- Featurize words into orthographic and phonological vectors.☆40Updated last year
- FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…☆111Updated last month
- Code for EMNLP 2016 paper: Morphological Priors for Probabilistic Word Embeddings☆52Updated 8 years ago
- The Broad Twitter Corpus, an NER dataset in English stratified for time, location, social media genre, socioeconomic factors (COLING 2016…☆66Updated 2 years ago
- spaCy-to-naf converter☆21Updated 9 months ago
- An example of how to use spaCy for extremely large files without running into memory issues☆36Updated 2 years ago
- A way to do annotations for NER. TALEN: Tool for Annotation of Low-resource ENtities☆113Updated 2 years ago
- Fast supervised sentence boundary detection using the averaged perceptron☆90Updated 6 years ago
- Utility scripts in Python☆37Updated 6 months ago
- Labeled examples from wiki dumps in Python☆67Updated 8 years ago
- Keras implementation of ontology aware token embeddings☆48Updated 6 years ago
- Python interface for converting Penn Treebank trees to Stanford Dependencies and Universal Depenencies☆70Updated 5 years ago
- Code for morphological transformations☆29Updated 7 years ago
- ☆64Updated 2 years ago
- A tool for text normalisation via character-level machine translation☆13Updated 4 years ago
- Non-distributional linguistic word vector representations.☆62Updated 7 years ago
- A python module to process data for Frame Semantic Parsing☆23Updated 4 years ago
- Normalizes lexically ill-formed text to its most likely clean text, e.g. "c u thr 2nite!" -> "see you there tonight!".☆63Updated 9 years ago
- A Dependency Parser for Tweets☆78Updated 5 years ago
- Workshop on Noisy User-generated Text (W-NUT)☆30Updated this week
- CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems☆58Updated 10 months ago
- SMOR (Stuttgart Morphology) with alternative lemmatization component☆12Updated last year