jonathandunn / common_crawl_corpus
Scripts for building a geo-located web corpus using Common Crawl data
☆11Updated 3 weeks ago
Alternatives and similar repositories for common_crawl_corpus
Users that are interested in common_crawl_corpus are comparing it to the libraries listed below
Sorting:
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆11Updated last year
- An example of how to use spaCy for extremely large files without running into memory issues☆36Updated 2 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆52Updated 4 years ago
- Code and models for our CLEF-HIPE (Named Entity Processing on Historical Newspapers) submissions☆19Updated 2 years ago
- A python library to generate highly realistic typos (fuzz-testing)☆11Updated 2 months ago
- MinScIE is an Open Information Extraction system which provides structured knowledge enriched with semantic information about citations.☆15Updated 5 years ago
- Finds linguistic patterns effortlessly☆36Updated last year
- Use spaCy for NLP and output to the FoLiA XML format.☆12Updated last year
- classify a job description (or noisy job title) into a ONET job title☆19Updated 8 years ago
- ☆17Updated 4 years ago
- An alternative approach for probabilistic topic modeling based on agglomerative clustering of topics (not documents)☆12Updated 4 years ago
- linguistic converter / merging tool for multi-level annotated corpora. graph-based (using Python and NetworkX).☆51Updated 2 years ago
- Named-Entity Recognition for Norwegian Bokmål and Nynorsk☆12Updated 5 years ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated 5 months ago
- spaCy-to-naf converter☆21Updated 11 months ago
- spaCy match and replace, maintaining conjugation☆35Updated 2 years ago
- Converter from UD-trees to BART representation☆36Updated last year
- sequence tagging with spaCy and crfsuite☆19Updated 2 years ago
- Analyze Argumentation and Rhetorical Aspects in Scientific Writing.☆19Updated 2 years ago
- This repository includes all the code and data for the paper ELiDi (End2end Entity Linking and Disambiguation)☆14Updated 3 years ago
- Text readability metrics in Python.☆11Updated 11 years ago
- Language Tool style grammar handling with spaCy 2.0☆42Updated 6 years ago
- A Named-Entity Recogniser based on Grobid.☆52Updated this week
- STREUSLE: a corpus with comprehensive lexical semantic annotation (multiword expressions, supersenses)☆66Updated 2 years ago
- MoodCat😼 classifies the mood of English sentences.☆14Updated 2 years ago
- OpenNeuroSpell contains parts of NeuroSpell (http://neurospell.com/en.php) released as open-source. More code will be published as soon a…☆20Updated 6 months ago
- Build intelligent data-driven applications with minimal effort. Sentence Clustering, Topics Extraction, Text Similarity, Opinion Summariz…☆40Updated 5 years ago
- ☆16Updated 6 years ago
- FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…☆112Updated 3 months ago
- ☆30Updated 2 years ago