viktorfa / scrapy-fargate-sls-guide
A guide/tutorial for running Scrapy with a serverless paradigm
☆32Updated 2 years ago
Alternatives and similar repositories for scrapy-fargate-sls-guide:
Users that are interested in scrapy-fargate-sls-guide are comparing it to the libraries listed below
- sample code for tech blog post "Porting Flask to FastAPI for ML Model Serving"☆29Updated last year
- A job scraper using the Scrapy framework☆17Updated 7 years ago
- More flexible and featured Frontera scheduler for Scrapy☆36Updated 3 months ago
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆75Updated 3 years ago
- Using Amazon Comprehend, Amazon Elasticsearch with Kibana, Amazon S3, Amazon Cognito to search over large number of documents.☆24Updated 10 months ago
- A project providing a Lambda Layer that provides SQLite support in Python3.6 Lambdas☆25Updated 6 years ago
- Scrapy Deployed on AWS Lambda☆11Updated 2 years ago
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- Serverless Template for a Flask application☆80Updated 6 years ago
- Scraping tweets quickly using celery, RabbitMQ and Docker cluster☆48Updated 2 years ago
- boilerplate code to start with celery and rabbitmq in docker cluster☆20Updated 2 years ago
- Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website☆44Updated 7 years ago
- Example code that launches a docker container on AWS Fargate from AWS Lambda☆18Updated 7 years ago
- ☆16Updated 2 years ago
- Techniques for Scraping the Web in Python☆26Updated 6 years ago
- Building Serverless Python Web Services with Zappa, published by Packt☆43Updated 2 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆51Updated 6 years ago
- Scrapy project boilerplate done right☆45Updated last month
- 💾 Script to import issues from a JIRA instance into a database.☆56Updated 2 years ago
- Event-driven, Serverless Architectures with AWS Lambda, SQS, DynamoDB, and API Gateway☆36Updated 3 years ago
- This project explores the usage of Flask and Flask-RESTPlus in developing a Python service to host any application as well as exploring A…☆50Updated 5 years ago
- The Text Analysis with Amazon Comprehend and Amazon OpenSearch Service solution is an automated reference implementation that deploys a c…☆32Updated 5 months ago
- A pretty basic template that I use when working with Serverless and Python.☆18Updated 6 years ago
- A microservice monorepo example project using AWS Lambdas and Python☆19Updated 4 years ago
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 8 years ago
- Chrome extension that will scrape a linkedin profile.☆32Updated 2 years ago
- A Pythonic API for Amazon's States Language for defining AWS Step Functions☆8Updated 2 years ago
- Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management☆17Updated 7 years ago