Alternatives and similar repositories for scrapyd-k8s:

Users that are interested in scrapyd-k8s are comparing it to the libraries listed below

• rangertaha / scrapy-prometheus-exporter
  Scrapy stats exporter for prometheus
  ☆18Updated 3 months ago
• jxlil / scrapy-impersonate
  Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.
  ☆121Updated 3 months ago
• clemfromspace / scrapy-puppeteer
  Scrapy + Puppeteer
  ☆111Updated 3 years ago
• tieyongjie / scrapy-fingerprint
  ☆61Updated last year
• ConlinH / aio-scrapy
  Implement scrapy with asyncio
  ☆59Updated 3 months ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆96Updated this week
• my8100 / logparser
  A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
  ☆90Updated 3 weeks ago
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆100Updated 4 years ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated this week
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆45Updated 3 years ago
• MeiK2333 / pyppeteer_stealth
  ☆256Updated 3 years ago
• scrapinghub / scrapy-frontera
  More flexible and featured Frontera scheduler for Scrapy
  ☆36Updated 2 months ago
• ScrapeOps / scrapeops-scrapy-sdk
  Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the…
  ☆36Updated 6 months ago
• EasyPi / docker-scrapyd
  🕷️ Scrapyd is an application for deploying and running Scrapy spiders.
  ☆82Updated 2 months ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆62Updated this week
• mcolella14 / python_ghost_cursor
  Python port of Xetera/ghost-cursor, for use with Pyppeteer and Playwright.
  ☆63Updated 2 years ago
• bitmakerla / estela
  estela, an elastic web scraping cluster 🕸
  ☆175Updated last week
• oxylabs / OxyParser
  ☆70Updated 10 months ago
• Insutanto / scrapy-distributed
  A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based componen…
  ☆55Updated last year
• ClericPy / ichrome
  Chrome controller for Humans, based on Chrome Devtools Protocol(CDP) and python3.7+.
  ☆240Updated last week
• synodriver / awsome_scrapy_utils
  awsome scrapy utils
  ☆56Updated 9 months ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆201Updated 3 weeks ago
• rmax / scrapy-inline-requests
  A decorator to write coroutine-like spider callbacks.
  ☆110Updated 2 years ago
• TeamHG-Memex / aquarium
  Splash + HAProxy + Docker Compose
  ☆198Updated 6 years ago
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆45Updated 3 months ago
• scrapinghub / spidermon
  Scrapy Extension for monitoring spiders execution.
  ☆535Updated last month
• tinyfish-io / tf-playwright-stealth
  A fork of https://github.com/AtuboDad/playwright_stealth
  ☆34Updated last week
• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆37Updated this week
• rebrowser / rebrowser-playwright-python
  A drop-in replacement for playwright-python patched with rebrowser-patches. It allows to pass modern automation detection tests.
  ☆48Updated last month
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆269Updated 3 years ago