Alternatives and similar repositories for crawlerflow:

Users that are interested in crawlerflow are comparing it to the libraries listed below

• svola / fantasticsearch
  Fantasticsearch will provide various search-engine templates for ElasticSearch
  ☆36Updated 8 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• crawlerflow / crawlerflow
  Orchestrate web crawlers to create structured datasets from multiple data sources with YAML configs.
  ☆14Updated 2 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated last year
• machinebox / textbox_elastic_indexer
  Example how to pre-process news articles with textbox and index on Elastic Search
  ☆13Updated 7 years ago
• DEKHTIARJonathan / FeedCrunch.IO
  FeedCrunch.IO - Take RSS Feeds to the next level with personnalized recommendations
  ☆15Updated 2 years ago
• boehm-e / spacy-raspberry
  A raspberry pi 64bit image with spacy and neuralcoref pre-installed
  ☆21Updated 5 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• matthewruttley / mozclassify
  Algorithms for URL Classification
  ☆19Updated 9 years ago
• johnymontana / russian-twitter-trolls
  Scraping Tweet data for Russian Troll Twitter accounts into Neo4j
  ☆57Updated 7 years ago
• pferrel / solr-recommender
  ☆16Updated 8 years ago
• madhusudancs / sentiment-analyzer
  Tweets Sentiment Analyzer
  ☆52Updated 13 years ago
• USCDataScience / NLTKRest
  This is a REST Server endpoint built using Flask and Python.
  ☆24Updated 2 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 10 months ago
• psolbach / metadoc
  Aviation grade news article metadata extraction
  ☆36Updated last year
• GISDev01 / tweets-nlp-elasticsearch
  A quick Elasticsearch/Logstash/Kibana (ELK) 7.x environment to quickly ingest realtime filtered tweets, perform Natural Language Processi…
  ☆16Updated 9 months ago
• vipul-sharma20 / summrizer
  A script to get summary of text content
  ☆31Updated 7 years ago
• dbs / postgresql-full-text-search-engine
  This application demonstrates how to use PostgreSQL as a full-text search engine.
  ☆63Updated 6 years ago
• rjbriody / linkedin-neo4j
  Load a linkedin network w/ python py2neo into a neo4j database, serve it via node.js, and display it w/ sigma.js
  ☆29Updated 11 years ago
• wobeng / zappa_resize_image_on_fly
  Resize image on the fly using flask, zappa, pillow, opencv-python
  ☆18Updated 7 years ago
• pschwede / AnchorBot
  The more often you click a word in the headlines, the more interesting are your news.
  ☆13Updated 8 years ago
• Riamse / ceterach
  An interface for interacting with MediaWiki
  ☆37Updated 3 years ago
• KevinPike / spacy-summary
  Text summarization using spacy
  ☆22Updated 2 years ago
• guillermo-carrasco / social_ids
  Get user ids from social network handlers
  ☆12Updated 8 years ago
• rotationalio / tribe
  Tribe extracts a network from an email mbox and writes it to a graphml file for visualization and analysis.
  ☆79Updated last year
• pculture / vidscraper
  Vidscraper is a python library which provides a simple API for fetching video data from various web services and sites.
  ☆62Updated 2 years ago
• iammai / docker-scrapy-crawler
  docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".
  ☆42Updated 9 years ago
• DansProjects / airflow-averageface
  Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website
  ☆44Updated 7 years ago
• Altarika / feet
  Feet is a tool for extracting entities from a text according to dictionaries.
  ☆11Updated 8 years ago
• Linkurious / PyLinkurious
  Linkurious.js integration with Jupyter notebooks
  ☆10Updated 7 years ago