viktorfa / scrapy-fargate-sls-guide
A guide/tutorial for running Scrapy with a serverless paradigm
☆32Updated last year
Related projects: ⓘ
- boilerplate code to start with celery and rabbitmq in docker cluster☆19Updated last year
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆74Updated 2 years ago
- ☆16Updated 2 years ago
- Python starter project for Serverless Framework☆37Updated 3 years ago
- A job scraper using the Scrapy framework☆17Updated 6 years ago
- Example code that launches a docker container on AWS Fargate from AWS Lambda☆18Updated 6 years ago
- Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website☆42Updated 6 years ago
- Python clients for Zyte AutoExtract API☆39Updated 2 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 3 years ago
- Scraping tweets quickly using celery, RabbitMQ and Docker cluster☆48Updated last year
- This application "listens" for a ticket creation event from Zendesk, analyses the ticket for negative sentiment, tags the ticket accordin…☆12Updated 2 years ago
- Building Serverless Python Web Services with Zappa, published by Packt☆43Updated last year
- Scrapy Deployed on AWS Lambda☆11Updated 2 years ago
- Zyte Automatic Extraction integration for Scrapy☆55Updated 2 years ago
- Python interface to the LinkedIn API - V2☆57Updated 2 years ago
- A demonstration of deploying flask on serverless (FaaS)☆12Updated 2 years ago
- A self-paced workshop designed to allow you to get hands on with building a real-time data platform using serverless technologies such as…☆22Updated 5 years ago
- More flexible and featured Frontera scheduler for Scrapy☆35Updated 8 months ago
- A project providing a Lambda Layer that provides SQLite support in Python3.6 Lambdas☆25Updated 5 years ago
- A Personalized 'Shop-by-Style' Experience via PyTorch on Amazon SageMaker and Amazon Neptune☆24Updated 3 years ago
- This solution deploys a lambda function and an API Gateway HTTP API to process tracking information from the HTTP request, returning a 1x…☆24Updated 3 years ago
- A pretty basic template that I use when working with Serverless and Python.☆18Updated 6 years ago
- Send confirmation emails to newly registered users with Flask, Redis Queue, and Amazon SES☆23Updated 2 months ago
- Different ways to deploy and run the FastAPI framework on AWS☆33Updated 2 years ago
- A cookiecutter template to create AWS Lambda function☆23Updated 5 years ago
- Repository for hosting models on AWS blog post☆14Updated 5 years ago
- Boto3 SQS Extended Client Library for Python. An extension to the boto3 sqs client that enables sending and receiving messages up to 2GB …☆27Updated 2 years ago
- Extensions for using Scrapy on Amazon AWS☆32Updated 11 years ago
- ☆23Updated 5 years ago
- Wrap pynamo models in pydantic schemas to make them easy to work with in FastAPI☆18Updated 4 months ago