Alternatives and similar repositories for cc-mrjob:

Users that are interested in cc-mrjob are comparing it to the libraries listed below

• trivio / common_crawl_index
  Index URLs in Common Crawl
  ☆194Updated 7 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆189Updated 6 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated 11 months ago
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 8 years ago
• explosion / displacy-ent
  displaCy-ent.js: An open-source named entity visualiser for the modern web
  ☆199Updated 6 years ago
• dat / pyner
  Python interface to the Stanford Named Entity Recognizer
  ☆292Updated 3 years ago
• turian / topia.termextract
  Updates to Zope's keyphrase extractor (forked from 1.1.0)
  ☆67Updated 7 years ago
• piskvorky / gensim-simserver
  [NO LONGER MAINTAINED AS OPEN SOURCE - USE SCALETEXT.COM INSTEAD]
  ☆108Updated 11 years ago
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆114Updated 3 weeks ago
• cirlabs / citizen-quotes
  A project to demonstrate maximum entropy models for extracting quotes from news articles in Python.
  ☆49Updated 12 years ago
• pavlobaron / wpcorpus
  wpcorpus - NLP corpus based on Wikipedia's full article dump
  ☆97Updated 9 years ago
• GregBowyer / cld2-cffi
  Python bindings to the Compact Language Detector
  ☆33Updated 4 years ago
• misja / python-boilerpipe
  Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages
  ☆543Updated 3 years ago
• explosion / spacy-dev-resources
  💫 Scripts, tools and resources for developing spaCy
  ☆125Updated 6 years ago
• shuyo / ldig
  Language Detection with Infinity-gram
  ☆231Updated 9 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 9 years ago
• vu3jej / scrapy-corenlp
  ☆59Updated 3 years ago
• seomoz / dragnet_data
  Training/test data for Dragnet
  ☆41Updated 10 years ago
• internetarchive / warc
  Python library for reading and writing warc files
  ☆239Updated 3 years ago
• explosion / spacy-services
  💫 REST microservices for various spaCy-related tasks
  ☆240Updated 2 years ago
• piskvorky / sim-shootout
  Code for "Performance shootout between nearest-neighbour libraries": http://radimrehurek.com/2013/11/performance-shootout-of-nearest-neig…
  ☆99Updated 9 years ago
• DiceTechJobs / ConceptualSearch
  Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jo…
  ☆257Updated 5 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 7 years ago
• willf / segment
  A tool to segment text based on frequencies and the Viterbi algorithm "#TheBoyWhoLived" => ['#', 'The', 'Boy', 'Who', 'Lived']
  ☆82Updated 8 years ago
• rossf7 / elasticrawl
  Launch AWS Elastic MapReduce jobs that process Common Crawl data.
  ☆49Updated 8 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• nickdavidhaynes / spacy-cld
  Language detection extension for spaCy 2.0+
  ☆112Updated 6 years ago
• cnorthwood / ternip
  Temporal Expression Recognition and Normalisation in Python
  ☆78Updated 9 years ago
• Sotera / mitie-trainer
  Model Training tool for MITIE
  ☆79Updated 9 years ago
• pattern3 / pattern
  Goal: make Pattern compatible with Python 3.
  ☆59Updated 5 years ago