Alternatives and similar repositories for PythonScrapyBasicSetup:

Users that are interested in PythonScrapyBasicSetup are comparing it to the libraries listed below

• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• cvibhagool / scrapy-tor
  Scrapy integration with Tor for anonymous web scraping
  ☆46Updated 9 years ago
• TeamHG-Memex / autologin
  A project to attempt to automatically login to a website given a single seed
  ☆123Updated 2 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 5 years ago
• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆63Updated last week
• zytedata / zyte-smartproxy-headless-proxy
  A complimentary proxy to help to use SPM with headless browsers
  ☆108Updated last year
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 6 years ago
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆205Updated 2 weeks ago
• scrapinghub / sample-projects
  Sample projects showcasing Scrapinghub tech
  ☆138Updated last year
• scrapinghub / scrapy-training
  Scrapy Training companion code
  ☆173Updated 6 years ago
• skynetbinary / major-scrapy-spiders
  Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon
  ☆283Updated 7 years ago
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆118Updated 8 months ago
• tonywangcn / docker-cluster-with-celery-and-rabbitmq
  Build Docker clusters with Celery and RabbitMQ in 10 minutes
  ☆75Updated 6 years ago
• further-reading / scrapy-gui
  A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.
  ☆109Updated 9 months ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• scrapinghub / learn.scrapinghub.com
  Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira: https://scrapinghub.atlassian.net/projects/WEB
  ☆55Updated 5 years ago
• TeamHG-Memex / domain-discovery-crawler
  Broad crawler for domain discovery
  ☆19Updated 6 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• scrapinghub / arche
  Analyze scraped data
  ☆46Updated 5 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated 9 months ago
• SerpentAI / selenium-respectful
  Minimalist Selenium WebDriver wrapper to work within rate limits of any amount of websites simultaneously. Parallel processing friendly.
  ☆51Updated 7 years ago
• ChrisRoark / beagle_scraper
  Scraper for categories and lists on ecommerce and other listing websites
  ☆42Updated 4 years ago
• ericfourrier / scrape-linkedin
  Scrape a public LinkedIn profile.
  ☆153Updated 7 months ago
• pythad / selenium_extensions
  Tools that will make writing tests, bots and scrapers using Selenium much easier
  ☆140Updated 2 months ago
• ponyriders / django-amazon-price-monitor
  Monitors prices of Amazon products via Product Advertising API
  ☆156Updated 5 years ago
• seomoz / url-py
  URL Transformation, Sanitization
  ☆103Updated last year
• TeamHG-Memex / aquarium
  Splash + HAProxy + Docker Compose
  ☆197Updated 6 years ago
• anuragrana / scraping_tweets_celery_rabbitmq_docker_cluster
  Scraping tweets quickly using celery, RabbitMQ and Docker cluster
  ☆48Updated 2 years ago
• adamlwgriffiths / amazon_scraper
  Provides content not accessible through the standard Amazon API
  ☆234Updated 7 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆126Updated 5 years ago