zseta / scrapy-templates

Related projects: ⓘ

• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆35Updated last week
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated 2 months ago
• rejoiceinhope / scrapy-proxy-pool
  ☆164Updated 4 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆93Updated 2 months ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆55Updated 2 years ago
• testdrivenio / concurrent-web-scraping
  Building a Concurrent Web Scraper with Python and Selenium
  ☆35Updated 2 years ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆190Updated last month
• elacuesta / scrapy-pyppeteer
  Pyppeteer integration for Scrapy
  ☆60Updated 3 years ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆61Updated last month
• clemfromspace / scrapy-cloudflare-middleware
  A Scrapy middleware to bypass the CloudFlare's anti-bot protection
  ☆105Updated 3 years ago
• croqaz / awesome-scrapy
  🕶 Awesome list of Scrapy tools and libraries
  ☆54Updated 4 years ago
• ian-kerins / amazon-python-scrapy-scraper
  Python Scrapy spider that scrapes all Amazon products from a keyword search
  ☆86Updated 2 years ago
• owen9825 / captcha-middleware
  A middleware layer for Scrapy that detects CAPTCHA tests and solves them
  ☆44Updated last year
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆39Updated 2 years ago
• jlgamez / indeed-jobs-scraper
  A Python web scraper to automate job search.
  ☆15Updated last year
• further-reading / scrapy-gui
  A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.
  ☆106Updated 3 months ago
• scrapinghub / scrapy-autounit
  Automatic unit test generation for Scrapy.
  ☆55Updated 3 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆97Updated 4 years ago
• EasyPi / docker-scrapyd
  🕷️ Scrapyd is an application for deploying and running Scrapy spiders.
  ☆77Updated 3 weeks ago
• sonyasha / chromedriver-heroku
  Web scraping with Selenium Webdriver and MongoDB, deployed to Heroku
  ☆12Updated last year
• groupbwt / scrapy-boilerplate
  Scrapy project boilerplate done right
  ☆43Updated 3 months ago
• ZenRows / scaling-to-distributed-crawling
  Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.
  ☆40Updated 2 years ago
• ispras / scrapy-puppeteer
  Library that helps use puppeteer in scrapy.
  ☆51Updated this week
• jcchouinard / SEO-Projects
  Repository of all public SEO projects I am working on.
  ☆43Updated last year
• scrapinghub / spidermon
  Scrapy Extension for monitoring spiders execution.
  ☆527Updated this week
• scrapinghub / price-parser
  Extract price amount and currency symbol from a raw text string
  ☆313Updated 11 months ago
• Lazar-T / Upwork-job-checker
  Get notified when new job is available at upwork.com
  ☆34Updated 6 years ago
• jschnurr / scrapyscript
  Run a Scrapy spider programmatically from a script or a Celery task - no project required.
  ☆121Updated 3 months ago
• DevMaxC / FastAPI-Selenium
  Railway Template for a FastAPI + Selenium service
  ☆25Updated last year
• Granitosaurus / playwright-stealth
  ☆121Updated 10 months ago