Alternatives and similar repositories for scrapy-training

Users that are interested in scrapy-training are comparing it to the libraries listed below

• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆204Updated 3 months ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆128Updated 6 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆184Updated 5 years ago
• scrapinghub / learn.scrapinghub.com
  Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira: https://scrapinghub.atlassian.net/projects/WEB
  ☆54Updated 6 years ago
• AccordBox / awesome-scrapy
  A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
  ☆554Updated 3 years ago
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆276Updated 10 months ago
• scrapinghub / sample-projects
  Sample projects showcasing Scrapinghub tech
  ☆138Updated last year
• TeamHG-Memex / aquarium
  Splash + HAProxy + Docker Compose
  ☆196Updated last week
• alecxe / scrapy-fake-useragent
  Random User-Agent middleware based on fake-useragent
  ☆691Updated 2 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 3 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆202Updated 6 years ago
• WSOL12 / Solana-Arbitrage-Bot
  Solana Arbitrage Bot on pump.fun, Meteora, Raydium and Orca using Jito bundling, RPC and gRPC. Solana Arbitrage Bot Solana Arbitrage Bot …
  ☆493Updated last month
• sebdah / scrapy-mongodb
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆358Updated 4 years ago
• djm / python-scrapyd-api
  A Python wrapper for working with Scrapyd's API.
  ☆271Updated last year
• scrapinghub / scrapyrt
  HTTP API for Scrapy spiders
  ☆873Updated 3 months ago
• sangaline / advanced-web-scraping-tutorial
  The Zipru scraper developed in the Advanced Web Scraping Tutorial.
  ☆426Updated 8 years ago
• lopuhin / scrapy-pyppeteer
  Use pyppeteer from a Scrapy spider
  ☆59Updated 5 years ago
• scrapy / w3lib
  Python library of web-related functions
  ☆412Updated last month
• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆368Updated 9 months ago
• cdrx / scrapyd-authenticated
  Docker container running scrapyd with HTTP authentication
  ☆41Updated last year
• TeamHG-Memex / arachnado
  Web Crawling UI and HTTP API, based on Scrapy and Tornado
  ☆160Updated last week
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆50Updated 7 years ago
• skynetbinary / major-scrapy-spiders
  Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon
  ☆296Updated 8 years ago
• further-reading / scrapy-gui
  A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.
  ☆110Updated last year
• holgerd77 / django-dynamic-scraper
  Creating Scrapy scrapers via the Django admin interface
  ☆1,160Updated 3 years ago
• cvibhagool / scrapy-tor
  Scrapy integration with Tor for anonymous web scraping
  ☆46Updated 10 years ago
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆79Updated 8 years ago
• notoriousno / scrapy-flask
  Execute Scrapy spiders in a Flask web application
  ☆68Updated 3 years ago
• lorien / user_agent
  Generator of User-Agent header
  ☆348Updated 4 months ago
• ponyriders / django-amazon-price-monitor
  Monitors prices of Amazon products via Product Advertising API
  ☆156Updated 6 years ago