Alternatives and similar repositories for crawlerflow:

Users that are interested in crawlerflow are comparing it to the libraries listed below

• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• pferrel / solr-recommender
  ☆16Updated 8 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 7 months ago
• psolbach / metadoc
  Aviation grade news article metadata extraction
  ☆36Updated last year
• ianozsvald / twitter_networkx_concept_map
  Take streaming tweets, extract hashtags & usernames, create graph, export graphml for Gephi visualisation
  ☆34Updated 11 years ago
• devvid / python-common-crawl-amazon-example
  Exploring Common-Crawl using Python and DynamoDB
  ☆33Updated 7 years ago
• haridas / IP-monitoring
  Monitor your IP reputation for Email sending or Email marketing.
  ☆43Updated 11 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• gfjreg / CommonCrawl
  A distributed system for mining common crawl using SQS, AWS-EC2 and S3
  ☆16Updated 10 years ago
• BBVA / Tarkin
  A tool for anomaly detection over streaming data based on sentiment analysis
  ☆30Updated 6 years ago
• pathbreak / deepvisualminer
  Deep visual mining for your photos and videos using YOLOv2 deep convolutional neural network based object detector and traditional face …
  ☆22Updated 6 years ago
• dbpedia / distributed-extraction-framework
  DBpedia Distributed Extraction Framework: Extract structured data from Wikipedia in a parallel, distributed manner
  ☆41Updated 2 years ago
• verifid / ner-d
  Python module for Named Entity Recognition (NER) using natural language processing.
  ☆13Updated 3 years ago
• koursaros-ai / microservices
  Neural Elastic Inference and Search
  ☆19Updated 5 years ago
• scrapinghub / scaws
  Extensions for using Scrapy on Amazon AWS
  ☆32Updated 12 years ago
• boehm-e / spacy-raspberry
  A raspberry pi 64bit image with spacy and neuralcoref pre-installed
  ☆21Updated 5 years ago
• crawlerflow / crawlerflow
  Orchestrate web crawlers to create structured datasets from multiple data sources with YAML configs.
  ☆14Updated 2 years ago
• matthewruttley / mozclassify
  Algorithms for URL Classification
  ☆19Updated 9 years ago
• xhresko / text-summarizer
  Simple program that summarize text.
  ☆10Updated 14 years ago
• volfpeter / localclustering
  Python 3 implementation and documentation of the Hermina-Janos local graph clustering algorithm.
  ☆21Updated last year
• DansProjects / airflow-averageface
  Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website
  ☆42Updated 7 years ago
• wobeng / zappa_resize_image_on_fly
  Resize image on the fly using flask, zappa, pillow, opencv-python
  ☆18Updated 7 years ago
• machinebox / textbox_elastic_indexer
  Example how to pre-process news articles with textbox and index on Elastic Search
  ☆13Updated 7 years ago
• lmangani / kibana_graph
  Interactive Network Graph Visualization For Kibana (unmaintained)
  ☆40Updated 6 years ago
• implydata / datazoo
  A collection of datasets and databases
  ☆24Updated 6 years ago
• goliasz / pio-template-text-similarity
  Text similarity based on Word2Vec vectors.
  ☆11Updated 7 years ago
• codelucas / shorten.tv
  Python video summarization. Visit the public API at -- www.shorten.tv (EDIT: The domain expired and youtube blocked it ..)
  ☆81Updated 2 years ago
• maxdemarzi / neo_graph_search
  A POC at replicating Facebook Graph Search with Cypher and Neo4j
  ☆102Updated 11 years ago
• svola / fantasticsearch
  Fantasticsearch will provide various search-engine templates for ElasticSearch
  ☆36Updated 8 years ago