Alternatives and similar repositories for common_crawl_corpus:

Users that are interested in common_crawl_corpus are comparing it to the libraries listed below

• transducens / linguacrawl
  Crawling engine that crawls a set of top-level domains looking for documents in a list of languages
  ☆10Updated last year
• BramVanroy / spacy-extreme
  An example of how to use spaCy for extremely large files without running into memory issues
  ☆36Updated 2 years ago
• proycon / spacy2folia
  Use spaCy for NLP and output to the FoLiA XML format.
  ☆12Updated last year
• revuel / PatternOmatic
  Finds linguistic patterns effortlessly
  ☆36Updated last year
• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 4 years ago
• saffsd / polyglot
  Polyglot is a language identifier for detecting text documents containing text written in more than one language, and for identifying the…
  ☆33Updated 8 years ago
• wjbmattingly / bagpipes-spacy
  Bagpipes spaCy is a collection of custom spaCy pipeline components designed to enhance text processing capabilities.
  ☆16Updated 7 months ago
• anlausch / ArguminSci
  Analyze Argumentation and Rhetorical Aspects in Scientific Writing.
  ☆19Updated 2 years ago
• alexyorke / butter-fingers
  A python library to generate highly realistic typos (fuzz-testing)
  ☆11Updated 2 weeks ago
• proycon / flat
  FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…
  ☆112Updated 2 months ago
• UCREL / pymusas
  Python Multilingual Ucrel Semantic Analysis System
  ☆31Updated 7 months ago
• cltl / SpaCy-to-NAF
  spaCy-to-naf converter
  ☆21Updated 9 months ago
• mjpost / bin
  bin files
  ☆13Updated 2 months ago
• clips / wordkit
  Featurize words into orthographic and phonological vectors.
  ☆40Updated last year
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• allenai / pybart
  Converter from UD-trees to BART representation
  ☆36Updated last year
• talmago / spacy_crfsuite
  sequence tagging with spaCy and crfsuite
  ☆19Updated 2 years ago
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆22Updated 3 years ago
• bltlab / paranames
  ParaNames: A multilingual resource for parallel names
  ☆31Updated 10 months ago
• ziyin-dl / ngram-word2vec
  ☆17Updated 3 years ago
• fnielsen / wembedder
  Wikidata embedding
  ☆50Updated 4 months ago
• nelson-liu / lexical-semantic-recognition
  ☆17Updated last year
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated 3 weeks ago
• Waino / LeBLEU
  LeBLEU: Levenshtein/Letter-edit BLEU, N-gram-based Translation Evaluation Score for Morphologically Complex Languages
  ☆10Updated 4 years ago
• latynt / ans
  Arabic News Stance Corpus
  ☆10Updated 4 years ago
• kristopherkyle / TAALED
  Tool for the Automatic Assessment of Lexical Diversity
  ☆11Updated 4 years ago
• sortiz / tmxt
  Transform TMX to text
  ☆28Updated 2 years ago
• arne-cl / discoursegraphs
  linguistic converter / merging tool for multi-level annotated corpora. graph-based (using Python and NetworkX).
  ☆51Updated last year
• cltl / KafNafParserPy
  Parser for KAF NAF files written in Python
  ☆16Updated 3 years ago
• liao961120 / concordancer
  Searching in-memory corpus with Corpus Query Language (CQL)
  ☆19Updated 4 months ago