Alternatives and similar repositories for scrapy-rotating-proxies:

Users that are interested in scrapy-rotating-proxies are comparing it to the libraries listed below

• alecxe / scrapy-fake-useragent
  Random User-Agent middleware based on fake-useragent
  ☆689Updated last year
• scrapinghub / spidermon
  Scrapy Extension for monitoring spiders execution.
  ☆534Updated 3 weeks ago
• scrapinghub / scrapyrt
  HTTP API for Scrapy spiders
  ☆837Updated 5 months ago
• istresearch / scrapy-cluster
  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
  ☆1,183Updated last year
• scrapy / scrapyd-client
  Command line client for Scrapyd server
  ☆770Updated last month
• aivarsk / scrapy-proxies
  Random proxy middleware for Scrapy
  ☆1,659Updated 5 years ago
• clemfromspace / scrapy-selenium
  Scrapy middleware to handle javascript pages using selenium
  ☆925Updated 4 months ago
• AccordBox / awesome-scrapy
  A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
  ☆540Updated last year
• scrapy-plugins / scrapy-playwright
  🎭 Playwright integration for Scrapy
  ☆1,036Updated 2 weeks ago
• rejoiceinhope / scrapy-proxy-pool
  ☆164Updated 4 years ago
• scrapinghub / frontera
  A scalable frontier for web crawlers
  ☆1,305Updated last year
• clemfromspace / scrapy-cloudflare-middleware
  A Scrapy middleware to bypass the CloudFlare's anti-bot protection
  ☆106Updated 3 years ago
• TeamHG-Memex / aquarium
  Splash + HAProxy + Docker Compose
  ☆198Updated 6 years ago
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆2,979Updated 3 weeks ago
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,159Updated last year
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆268Updated 3 years ago
• fabienvauchelles / scrapoxy
  Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrape…
  ☆2,060Updated this week
• djm / python-scrapyd-api
  A Python wrapper for working with Scrapyd's API.
  ☆268Updated 4 months ago
• scrapy / scrapely
  A pure-python HTML screen-scraping library
  ☆1,864Updated 2 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆201Updated 5 years ago
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,099Updated 4 months ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated 2 weeks ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆198Updated last month
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,744Updated last year
• scrapinghub / js2xml
  Convert Javascript code to an XML document
  ☆186Updated 2 years ago
• clemfromspace / scrapy-puppeteer
  Scrapy + Puppeteer
  ☆111Updated 3 years ago
• NikolaiT / Crawling-Infrastructure
  Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.
  ☆415Updated last year
• scrapinghub / price-parser
  Extract price amount and currency symbol from a raw text string
  ☆316Updated 3 weeks ago
• AtuboDad / playwright_stealth
  playwright stealth
  ☆549Updated 4 months ago
• jxlil / scrapy-impersonate
  Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.
  ☆111Updated 2 months ago