q-m / scrapyd-k8s
Scrapyd on container infrastructure
☆12Updated this week
Related projects ⓘ
Alternatives and complementary repositories for scrapyd-k8s
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.☆111Updated last month
- ☆57Updated last year
- Page Object pattern for Scrapy☆119Updated this week
- Scrapy + Puppeteer☆111Updated 3 years ago
- A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based componen…☆55Updated last year
- Implement scrapy with asyncio☆58Updated last month
- ☆125Updated last year
- Pyppeteer integration for Scrapy☆60Updated 3 years ago
- A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.☆89Updated 2 years ago
- Chrome controller for Humans, based on Chrome Devtools Protocol(CDP) and python3.7+.☆236Updated 3 weeks ago
- Zyte API integration for Scrapy☆36Updated this week
- Patching CDP (Chrome DevTools Protocol) leaks on OS level. Easy to use with Playwright, Selenium, and other web automation tools.☆79Updated 3 months ago
- Python client and types generator for the Chrome DevTools Protocol (CDP)☆57Updated 2 weeks ago
- 🕷️ Scrapyd is an application for deploying and running Scrapy spiders.☆79Updated 2 weeks ago
- An advanced antibot for webdrivers☆109Updated last month
- Python port of Xetera/ghost-cursor, for use with Pyppeteer and Playwright.☆52Updated 2 years ago
- An intelligent web service to automatically detect web content and extract information from it.☆84Updated last year
- Splash + HAProxy + Docker Compose☆198Updated 5 years ago
- ☆251Updated 3 years ago
- Detect and classify pagination links☆99Updated 4 years ago
- Undetected version of the Playwright testing and automation library.☆270Updated this week
- playwright stealth☆544Updated 3 months ago
- Scrapy stats exporter for prometheus☆17Updated 3 weeks ago
- Web scraping Page Objects core library☆95Updated last month
- A drop-in replacement for playwright-python patched with rebrowser-patches. It allows to pass modern automation detection tests.☆33Updated 3 weeks ago
- A complimentary proxy to help to use SPM with headless browsers☆110Updated last year
- More flexible and featured Frontera scheduler for Scrapy☆35Updated 10 months ago
- Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the…☆37Updated 4 months ago
- A Python 3 to Deno + worker-vm binding, helps you execute JavaScript safely.☆15Updated 7 months ago
- 🔮 Vindicate non-organic web traffic via MITM proxy☆41Updated 4 months ago