Alternatives and similar repositories for common_crawl_corpus

Users that are interested in common_crawl_corpus are comparing it to the libraries listed below

• transducens / linguacrawl
  Crawling engine that crawls a set of top-level domains looking for documents in a list of languages
  ☆11Updated last year
• tokestermw / spacy_grammar
  Language Tool style grammar handling with spaCy 2.0
  ☆42Updated 7 years ago
• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 5 years ago
• Mrezvan94 / Harassment-Corpus
  Harassment Lexicon and Corpus
  ☆30Updated 7 years ago
• plkumjorn / GrASP
  An implementation of GrASP (Shnarch et. al., 2017)
  ☆21Updated 3 years ago
• kermitt2 / grobid-ner
  A Named-Entity Recogniser based on Grobid.
  ☆54Updated 3 months ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• NLPAssignment / metaphor-detection
  Metaphor detection using NLP techniques, made in Python using NLTK
  ☆18Updated 11 years ago
• BramVanroy / spacy-extreme
  An example of how to use spaCy for extremely large files without running into memory issues
  ☆36Updated 2 years ago
• chozelinek / europarl
  Toolkit to compile a comparable/parallel corpus from European Parliament proceedings
  ☆16Updated 5 years ago
• RxNLP / PyRXNLP
  Build intelligent data-driven applications with minimal effort. Sentence Clustering, Topics Extraction, Text Similarity, Opinion Summariz…
  ☆40Updated 5 years ago
• oudalab / Arabic-NER
  ☆32Updated 7 years ago
• gamebusterz / French-Sentiment-Analysis-Dataset
  A collection of over 1.5 Million tweets data translated to French, with their sentiment.
  ☆35Updated 8 years ago
• loomchild / maligna
  Bilingual sengence aligner
  ☆28Updated last year
• alexyorke / butter-fingers
  A python library to generate highly realistic typos (fuzz-testing)
  ☆12Updated 5 months ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 6 years ago
• mikekestemont / pystyl
  Python package for stylometry
  ☆63Updated 4 years ago
• CrowdTruth / CrowdTruth-core
  CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems
  ☆61Updated last year
• modernmt / DataCollection
  Data collection, alignment and TAUS repository
  ☆23Updated 7 years ago
• TextRazor / textrazor-python
  Python SDK for the TextRazor Text Analytics API
  ☆20Updated last year
• CogComp / talen
  A way to do annotations for NER. TALEN: Tool for Annotation of Low-resource ENtities
  ☆118Updated last month
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆14Updated 2 weeks ago
• AudayBerro / automatedParaphrase
  Automated paraphrases Generation
  ☆36Updated 2 years ago
• alexerdmann / HER
  Humanities Entity Recognition: robust, practical, efficient Named Entity Recognition for today's digital humanist
  ☆37Updated 6 years ago
• epfl-dlab / quootstrap
  Unsupervised method for extracting quotation-speaker pairs from large news corpora.
  ☆29Updated 7 years ago
• gkiril / MinSCIE
  MinScIE is an Open Information Extraction system which provides structured knowledge enriched with semantic information about citations.
  ☆15Updated 6 years ago
• writer / fitbert
  Use BERT to Fill in the Blanks
  ☆83Updated 3 years ago
• mikahama / natas
  Python 3 library for processing historical English
  ☆67Updated last year
• dennlinger / TopicalChange
  Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.
  ☆97Updated 2 years ago
• anlausch / ArguminSci
  Analyze Argumentation and Rhetorical Aspects in Scientific Writing.
  ☆19Updated 2 years ago