Alternatives and similar repositories for crawlerflow

Users that are interested in crawlerflow are comparing it to the libraries listed below

• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 4 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆57Updated last year
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated last year
• DEKHTIARJonathan / FeedCrunch.IO
  FeedCrunch.IO - Take RSS Feeds to the next level with personnalized recommendations
  ☆15Updated 3 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆99Updated 5 years ago
• shaildeliwala / delbot
  It understands your voice commands, searches news and knowledge sources, and summarizes and reads out content to you.
  ☆213Updated 5 years ago
• pferrel / solr-recommender
  ☆16Updated 9 years ago
• bahn / wikitopics
  Exploits Wikipedia's daily view counts to find out what topics are current trends
  ☆18Updated 12 years ago
• tasdikrahman / spammy
  Spam filtering made easy for you
  ☆144Updated 6 years ago
• jondot / pgpipeline
  A Scrapy pipeline module to persist items to a postgres table automatically.
  ☆21Updated 8 years ago
• Sotera / newman
  Quickly analyze and explore email with advanced analytics and visualization.
  ☆56Updated 4 years ago
• LogicLady / email-saga
  Extract Social Profiles using Email Addresses (Python)
  ☆14Updated 7 years ago
• toumorokoshi / nlgen
  Natural Language Generator for Python
  ☆27Updated 8 years ago
• openpreserve / pagelyzer
  Suite of tools for detecting changes in web pages and their rendering
  ☆55Updated last year
• bexp / textai
  REST API for Text Summarization and Keywords Extraction
  ☆16Updated 2 years ago
• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆134Updated 2 years ago
• toxtli / linkedin-profile-scraper
  This is a complete profile scraper that returns a JSON file.
  ☆53Updated 7 years ago
• devvid / python-common-crawl-amazon-example
  Exploring Common-Crawl using Python and DynamoDB
  ☆33Updated 7 years ago
• codelucas / shorten.tv
  Python video summarization. Visit the public API at -- www.shorten.tv (EDIT: The domain expired and youtube blocked it ..)
  ☆81Updated 3 years ago
• anuragrana / scraping_tweets_celery_rabbitmq_docker_cluster
  Scraping tweets quickly using celery, RabbitMQ and Docker cluster
  ☆50Updated 2 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 3 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆92Updated last week
• melvynator / ELK_twitter
  This is a data pipeline for Twitter (ETL) using the elastic stack Elasticsearch, Logstash and Kibana (version 6.1)
  ☆59Updated 7 years ago
• crawlerflow / crawlerflow
  Orchestrate web crawlers to create structured datasets from multiple data sources with YAML configs.
  ☆14Updated 2 years ago
• gsi-upm / senpy
  A sentiment and emotion analysis server in Python
  ☆70Updated 10 months ago
• kelaraj / linkedin_scrapy
  Scrape every LinkedIn public profile using Scrapy (Python)
  ☆15Updated 10 years ago
• app-generator / flask-argon-design-system
  Flask App - Argon Design System | AppSeed
  ☆11Updated 5 years ago
• hellpanderrr / linkedin-pdf-parsing
  Parsing resumes in a PDF format from linkedIn
  ☆68Updated 9 years ago
• adamfabish / Reduction
  Reduction is a python script which automatically summarizes a text by extracting the sentences which are deemed to be most important.
  ☆54Updated 10 years ago
• theju / smp
  Social Media Post scheduler
  ☆23Updated 8 years ago