acordiner / scrapy-dynamodbLinks
AWS DynamoDB pipeline for Scrapy
☆22Updated 2 months ago
Alternatives and similar repositories for scrapy-dynamodb
Users that are interested in scrapy-dynamodb are comparing it to the libraries listed below
Sorting:
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆75Updated 3 years ago
- A guide/tutorial for running Scrapy with a serverless paradigm☆33Updated 2 years ago
- Python3 interface to the LinkedIn API☆84Updated 4 years ago
- Python Client for Metabase Rest Api☆79Updated 2 years ago
- A middleware layer for Scrapy that detects CAPTCHA tests and solves them☆45Updated last year
- Singer.io tap for Facebook Marketing API☆114Updated this week
- An example of a web scraper running on AWS Lambda and Lambda Layers☆137Updated 3 years ago
- An image resizing API with Python and Serverless framework☆22Updated 6 years ago
- Automatic unit test generation for Scrapy.☆56Updated 3 years ago
- Example app to be deployed to AWS as an API Gateway / Lambda Stack☆133Updated 3 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- JavaScript support and proxy rotation for Scrapy with ScrapingBee.☆38Updated last year
- Ultimate Website Sitemap Parser☆219Updated last month
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆122Updated last year
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- ☆23Updated 6 years ago
- 🐍 A lightweight Python client for LocalStack☆187Updated 2 months ago
- Amazon Kinesis Client Library for Python☆374Updated last week
- Unzip function for AWS Lambda☆54Updated 6 years ago
- An example project for gremlin_python, as there is very little public code out there using it.☆38Updated 5 years ago
- Python interface to the LinkedIn API - V2☆57Updated 3 years ago
- Scrape the Google search result with Scrapy.☆98Updated 5 years ago
- Sample implementation of a simple AWS SWF app using boto3☆14Updated 9 years ago
- AWS Lambda Layer for headless chromium with extra CJK font support☆55Updated 6 years ago
- fast and scalable Airflow on Kubernetes Setup.☆28Updated 2 years ago
- Helper library to run AWS Glue ETL scripts docker container for local testing of development in a Jupyter notebook☆20Updated last year
- Lets you import Tensorflow + Keras from an AWS lambda☆86Updated 6 years ago
- Analyze scraped data☆46Updated 5 years ago
- Example frontera project☆12Updated 7 years ago
- Python Lambda Chrome Automation (naming pending)☆295Updated 8 months ago