viktorfa / scrapy-fargate-sls-guideLinks
A guide/tutorial for running Scrapy with a serverless paradigm
☆33Updated 2 years ago
Alternatives and similar repositories for scrapy-fargate-sls-guide
Users that are interested in scrapy-fargate-sls-guide are comparing it to the libraries listed below
Sorting:
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆75Updated 3 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 4 years ago
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- A demonstration of deploying flask on serverless (FaaS)☆12Updated 2 years ago
- A job scraper using the Scrapy framework☆16Updated 7 years ago
- Building Serverless Python Web Services with Zappa, published by Packt☆44Updated 2 years ago
- boilerplate code to start with celery and rabbitmq in docker cluster☆20Updated 2 years ago
- A cookiecutter template to create AWS Lambda function☆23Updated 6 years ago
- WSGI adapter for AWS API Gateway/Lambda Proxy Integration. Mirrored from GitLab.☆19Updated 6 years ago
- Software stack with latest Scrapy and updated deps☆64Updated 3 months ago
- Scrapy Deployed on AWS Lambda☆11Updated 2 years ago
- More flexible and featured Frontera scheduler for Scrapy☆37Updated 6 months ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 8 years ago
- Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website☆44Updated 7 years ago
- Python example using Boto3 to deploy to Amazon ECS☆17Updated 9 years ago
- A daemon for scheduling Scrapy spiders☆66Updated 4 years ago
- Resize image on the fly using flask, zappa, pillow, opencv-python☆18Updated 7 years ago
- A Personalized 'Shop-by-Style' Experience via PyTorch on Amazon SageMaker and Amazon Neptune☆24Updated 4 years ago
- Python starter project for Serverless Framework☆38Updated 3 years ago
- ☆16Updated 2 years ago
- Serverless Template for a Flask application☆80Updated 6 years ago
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".☆42Updated 10 years ago
- A project providing a Lambda Layer that provides SQLite support in Python3.6 Lambdas☆25Updated 6 years ago
- A small Python module containing quick utility functions for standard ETL processes.☆35Updated last month
- sample code for tech blog post "Porting Flask to FastAPI for ML Model Serving"☆28Updated last year
- Using Amazon Comprehend, Amazon Elasticsearch with Kibana, Amazon S3, Amazon Cognito to search over large number of documents.☆24Updated last year
- JavaScript support and proxy rotation for Scrapy with ScrapingBee.☆38Updated last year
- 💾 Script to import issues from a JIRA instance into a database.☆56Updated 2 years ago
- Sample implementation of a simple AWS SWF app using boto3☆14Updated 9 years ago