Alternatives and similar repositories for dirbot

Users that are interested in dirbot are comparing it to the libraries listed below

• julien-duponchelle / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆98Updated 7 years ago
• realpython / stack-spider
  ☆167Updated 7 years ago
• corywalker / selenium-crawler
  Sometimes sites make crawling hard. Selenium-crawler uses selenium automation to fix that.
  ☆125Updated 12 years ago
• scrapinghub / docker-images
  ☆33Updated 2 weeks ago
• iammai / docker-scrapy-crawler
  docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".
  ☆42Updated 10 years ago
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated last year
• cantabular / scraperwiki-python
  ScraperWiki Python library for scraping and saving data
  ☆158Updated 2 years ago
• scrapy / loginform
  Fill HTML login forms automatically
  ☆276Updated last year
• scrapinghub / scmongo
  MongoDB extensions for Scrapy
  ☆44Updated 11 years ago
• scrapinghub / crawlera-tools
  Crawlera tools
  ☆26Updated 9 years ago
• jayzeng / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆323Updated 3 years ago
• minimaxir / system-dashboard
  Minimalist Win/OSX/Linux System Dashboard using Flask and Freeboard
  ☆202Updated 9 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 10 years ago
• realpython / twitter-sentiment-elasticsearch
  Let's perform Twitter sentiment analysis using Python, Docker, Elasticsearch, and Kibana!
  ☆138Updated 5 years ago
• danecjensen / subscribely
  **Available for Contract Work** A boilerplate for building your own subscription site with stripe integration or stripe subscription serv…
  ☆222Updated 13 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 7 years ago
• qoda / python-mailer
  Send bulk html emails from the commandline or in your python script by specifying a database of recipients in csv form, a html template w…
  ☆101Updated 5 years ago
• bonzanini / CheerMeApp-demo
  Small demo for a "search-as-you-type" app in AngularJS + Python/Flask + Elasticsearch
  ☆69Updated 8 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated last year
• ClimbsRocks / empythy
  Automated NLP sentiment predictions- batteries included, or use your own data
  ☆18Updated 7 years ago
• Alir3z4 / python-sanitize
  Bringing sanity to world of messed-up data
  ☆66Updated 11 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 4 years ago
• RobSpectre / Twilio-Hackpack-for-Heroku-and-Flask
  The fastest way to start using Twilio with Python.
  ☆99Updated 6 years ago
• pyeve / eve-demo-client
  A very simple API consumer, used to reset the 'Eve Demo' Web REST API
  ☆53Updated 7 years ago
• scrapy / slybot
  ☆223Updated 10 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 3 years ago
• SEL-Columbia / bamboo
  Dynamic data analysis over the web. The logic to your data dashboards.
  ☆156Updated 10 years ago
• matiasb / demiurge
  PyQuery-based scraping micro-framework.
  ☆118Updated 3 years ago
• evidens / json2csv
  Converts JSON files to CSV (pulling data from nested structures). Useful for Mongo data
  ☆264Updated 4 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago