testdrivenio / selenium-grid-docker-swarm
web scraping in parallel with Selenium Grid and Docker
☆35Updated last year
Alternatives and similar repositories for selenium-grid-docker-swarm:
Users that are interested in selenium-grid-docker-swarm are comparing it to the libraries listed below
- boilerplate code to start with celery and rabbitmq in docker cluster☆20Updated 2 years ago
- admin ui for scrapy/open source scrapinghub☆58Updated 3 years ago
- Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka Selenium for Async).☆57Updated 3 years ago
- A simple python tool that generates a requests/bs4 based web scraper☆26Updated 2 years ago
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆122Updated 8 months ago
- Setting up Stripe Checkout with Flask☆46Updated 9 months ago
- Send confirmation emails to newly registered users with Flask, Redis Queue, and Amazon SES☆23Updated 7 months ago
- Docker-based Python web stack (works for Django)☆59Updated this week
- Analyze scraped data☆46Updated 5 years ago
- Building Serverless Python Web Services with Zappa, published by Packt☆43Updated 2 years ago
- A scrapy middleware to use rotated proxy ip list.☆24Updated 6 years ago
- Running Flask on Docker Swarm☆37Updated 10 months ago
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆20Updated 8 years ago
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆75Updated 2 years ago
- Scraping tweets quickly using celery, RabbitMQ and Docker cluster☆48Updated 2 years ago
- Web Scraping Craigslist's Engineering Jobs in NY with Scrapy☆66Updated 7 years ago
- Building a Concurrent Web Scraper with Python and Selenium☆34Updated 3 years ago
- A middleware layer for Scrapy that detects CAPTCHA tests and solves them☆45Updated last year
- stripe connect with django☆30Updated 6 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- ☆18Updated 6 years ago
- Sample project showcasing Docker multi-stage builds in Python/Django project☆16Updated 5 years ago
- (discontinued)☆26Updated 2 years ago
- Python3 interface to the LinkedIn API☆84Updated 4 years ago
- Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website☆43Updated 7 years ago
- Code samples used in the blog post "How to Integrate Highcharts.js with Django"☆29Updated 6 years ago
- Scraping of LinkedIn Profiles: Creates an Excel file containing the personal data and the last job position of all the provided LinkedIn …☆119Updated last year
- A Django project template for Ansible Container☆18Updated 7 years ago
- Pyppeteer integration for Scrapy☆59Updated 4 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆109Updated 9 months ago