clemfromspace / scrapy-cloudflare-middleware

Related projects ⓘ

Alternatives and complementary repositories for scrapy-cloudflare-middleware

• AndreiDrang / python3-anticaptcha
  Python library for AntiCaptcha.
  ☆159Updated 2 weeks ago
• ad-m / python-anticaptcha
  Client library for solve captchas with Anticaptcha.com support.
  ☆223Updated 2 years ago
• Granitosaurus / playwright-stealth
  ☆124Updated last year
• zytedata / zyte-smartproxy-headless-proxy
  A complimentary proxy to help to use SPM with headless browsers
  ☆110Updated last year
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated this week
• jxlil / scrapy-impersonate
  Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.
  ☆109Updated last month
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆36Updated this week
• rmax / scrapy-inline-requests
  A decorator to write coroutine-like spider callbacks.
  ☆110Updated last year
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆197Updated last month
• jorgenkg / python-proxy-rotator
  An automatic proxy rotator - multithreaded & SSL
  ☆78Updated 3 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆95Updated last month
• droefs / HLISA
  A reimplementation of the Selenium API, emulating human interactions
  ☆73Updated last year
• rejoiceinhope / scrapy-proxy-pool
  ☆164Updated 4 years ago
• elacuesta / scrapy-pyppeteer
  Pyppeteer integration for Scrapy
  ☆60Updated 3 years ago
• pavlodvornikov / aiocfscrape
  A simple async Python module to bypass Cloudflare\'s anti-bot page. Based on aiohttp ClientSession.
  ☆76Updated 4 years ago
• MeiK2333 / pyppeteer_stealth
  ☆252Updated 3 years ago
• NikolaiT / stealthy-scraping-tools
  Minimal set of tools to conduct stealthy scraping.
  ☆150Updated last year
• xiaowangwindow / scrapy-rotated-proxy
  A scrapy middleware to use rotated proxy ip list.
  ☆24Updated 6 years ago
• daijro / browserforge
  🎭 Intelligent browser header & fingerprint generator
  ☆252Updated 5 months ago
• TeamHG-Memex / scrapy-rotating-proxies
  use multiple proxies with Scrapy
  ☆739Updated 2 years ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆62Updated last month
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆202Updated 10 months ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆98Updated 4 years ago
• JaredLGillespie / proxyscrape
  Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).
  ☆246Updated 8 months ago
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆267Updated 3 years ago
• TeamHG-Memex / aquarium
  Splash + HAProxy + Docker Compose
  ☆198Updated 5 years ago
• lorien / captcha_solver
  Universal python API to captcha solving services
  ☆243Updated last year
• scrapinghub / price-parser
  Extract price amount and currency symbol from a raw text string
  ☆316Updated 2 weeks ago