viktorfa / scrapy-fargate-sls-guide
A guide/tutorial for running Scrapy with a serverless paradigm
☆32Updated last year
Related projects ⓘ
Alternatives and complementary repositories for scrapy-fargate-sls-guide
- Python starter project for Serverless Framework☆38Updated 3 years ago
- ☆16Updated 2 years ago
- The Text Analysis with Amazon Comprehend and Amazon OpenSearch Service solution is an automated reference implementation that deploys a c…☆32Updated 3 weeks ago
- Basic tutorial of using Apache Airflow☆35Updated 6 years ago
- sample code for tech blog post "Porting Flask to FastAPI for ML Model Serving"☆29Updated last year
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆74Updated 2 years ago
- Scrapy Deployed on AWS Lambda☆11Updated 2 years ago
- boilerplate code to start with celery and rabbitmq in docker cluster☆19Updated last year
- Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website☆42Updated 7 years ago
- More flexible and featured Frontera scheduler for Scrapy☆35Updated 10 months ago
- Using Amazon Comprehend, Amazon Elasticsearch with Kibana, Amazon S3, Amazon Cognito to search over large number of documents.☆24Updated 6 months ago
- A self-paced workshop designed to allow you to get hands on with building a real-time data platform using serverless technologies such as…☆22Updated 5 years ago
- A demonstration of deploying flask on serverless (FaaS)☆12Updated 2 years ago
- Build and Deploy A Serverless Data Pipeline on AWS☆27Updated last year
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 8 years ago
- Example code that launches a docker container on AWS Fargate from AWS Lambda☆18Updated 6 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 3 years ago
- A Personalized 'Shop-by-Style' Experience via PyTorch on Amazon SageMaker and Amazon Neptune☆24Updated 3 years ago
- Opinionated Flask serverless starter kit☆95Updated 3 years ago
- A project providing a Lambda Layer that provides SQLite support in Python3.6 Lambdas☆25Updated 5 years ago
- FastAPI Simple application structure☆34Updated 4 years ago
- Generate Hive CREATE TABLE statements from json data☆10Updated 7 years ago
- A job scraper using the Scrapy framework☆17Updated 7 years ago
- Event-driven, Serverless Architectures with AWS Lambda, SQS, DynamoDB, and API Gateway☆36Updated 3 years ago
- Scraping tweets quickly using celery, RabbitMQ and Docker cluster☆47Updated last year
- This application "listens" for a ticket creation event from Zendesk, analyses the ticket for negative sentiment, tags the ticket accordin…☆13Updated 2 years ago
- Build and deploy a serverless data pipeline on AWS with no effort.☆110Updated last year
- ☆32Updated 4 years ago
- selenium with required binaries as one AWS Lambda Layer☆14Updated 3 years ago
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆84Updated last year