WebScrapingSolutions / scrapy-project-template

Related projects ⓘ

Alternatives and complementary repositories for scrapy-project-template

• elacuesta / scrapy-pyppeteer
  Pyppeteer integration for Scrapy
  ☆60Updated 3 years ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated this week
• ThomasAitken / scrapy-sessions
  A session-management extension for Scrapy.
  ☆11Updated 11 months ago
• jxlil / scrapy-impersonate
  Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.
  ☆109Updated last month
• omkarcloud / botasaurus-driver
  Super Fast, Super Anti-Detect, and Super Intuitive Web Driver
  ☆46Updated 2 months ago
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆24Updated this week
• scrapedia / scrapy-cookies
  A middleware of cookies persistence for Scrapy
  ☆26Updated last month
• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆36Updated this week
• scrapy-plugins / scrapy-headless
  ☆29Updated 3 years ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆197Updated last month
• ispras / scrapy-puppeteer
  Library that helps use puppeteer in scrapy.
  ☆52Updated this week
• scrapinghub / scrapy-frontera
  More flexible and featured Frontera scheduler for Scrapy
  ☆35Updated 10 months ago
• croqaz / awesome-scrapy
  🕶 Awesome list of Scrapy tools and libraries
  ☆56Updated 4 years ago
• Hudrolax / uc-docker
  undetected chromedriver Docker
  ☆30Updated last year
• AndreiDrang / python-rucaptcha
  Python library for RuCaptcha\2Captcha.
  ☆94Updated this week
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆95Updated last month
• milahu / aiohttp_chromium
  aiohttp-like interface to chromium. based on selenium_driverless to bypass cloudflare
  ☆47Updated last week
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆45Updated last month
• realslimshanky / Spider-Sense
  A browser extension to monitor your spiders deployed on Scrapy Cloud.
  ☆15Updated 3 years ago
• scrapy-plugins / scrapy-dotpersistence
  A scrapy extension to sync `.scrapy` folder to an S3 bucket
  ☆17Updated 2 years ago
• clemfromspace / scrapy-cloudflare-middleware
  A Scrapy middleware to bypass the CloudFlare's anti-bot protection
  ☆106Updated 3 years ago
• daijro / browserforge
  🎭 Intelligent browser header & fingerprint generator
  ☆254Updated 5 months ago
• HMaker / python-cdp
  Python client and types generator for the Chrome DevTools Protocol (CDP)
  ☆57Updated 2 weeks ago
• zytedata / python-zyte-api
  Python client for Zyte API
  ☆21Updated last month
• Granitosaurus / playwright-stealth
  ☆124Updated last year
• scrapy / itemadapter
  Common interface for data container classes
  ☆62Updated this week
• oxylabs / OxyMouse
  Mouse Movement Algorithms
  ☆144Updated last month
• ScrapingAnt / scrapingant-client-python
  ScrapingAnt API client for Python.
  ☆36Updated 4 months ago