acordiner / scrapy-dynamodbLinks
AWS DynamoDB pipeline for Scrapy
☆22Updated 8 months ago
Alternatives and similar repositories for scrapy-dynamodb
Users that are interested in scrapy-dynamodb are comparing it to the libraries listed below
Sorting:
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Updated 3 years ago
- AWS Lambda precomiled binaries for lxml 3.6.4 built for python 2.7 and python 3.6 runtimes☆65Updated 6 years ago
- Serverless selenium which dynamically execute any given code.☆64Updated 3 years ago
- Python Lambda Chrome Automation (naming pending)☆296Updated last year
- Python3 interface to the LinkedIn API☆84Updated 5 years ago
- Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website☆44Updated 8 years ago
- Python clients for Zyte AutoExtract API☆41Updated 3 years ago
- Python interface to the LinkedIn API - V2☆57Updated 4 years ago
- A guide/tutorial for running Scrapy with a serverless paradigm☆33Updated 2 years ago
- Ultimate Website Sitemap Parser☆234Updated last month
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- A simple wrapper for boto3 for listening, and sending, to an AWS SQS queue☆156Updated last year
- Automatic unit test generation for Scrapy.☆57Updated 4 years ago
- DynamoDB integration for Flask.☆141Updated 3 years ago
- A Python wrapper for the HubSpot APIs #hubspot-open-source☆80Updated 2 years ago
- Check if an email is valid with using SMTP, regexes and blacklists.This package has been migrated to https://git.ksol.io/karolyi/py3-vali…☆131Updated last year
- An example of a web scraper running on AWS Lambda and Lambda Layers☆138Updated 3 years ago
- python wrapper for metabase api☆50Updated 4 years ago
- Page Object pattern for Scrapy☆124Updated last month
- Example app to be deployed to AWS as an API Gateway / Lambda Stack☆142Updated 4 years ago
- A client interface for Scrapinghub's API☆205Updated 2 months ago
- A Python DB-API and SQLAlchemy dialect to Google Spreasheets☆224Updated 2 years ago
- Flask authentication with JWT against AWS Cognito☆96Updated last year
- Selenium UI testing with AWS Lambda Layers☆86Updated 5 years ago
- Splash + HAProxy + Docker Compose☆197Updated 7 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 4 years ago
- JavaScript support and proxy rotation for Scrapy with ScrapingBee.☆38Updated last year
- An image resizing API with Python and Serverless framework☆23Updated 6 years ago
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆121Updated last year
- Analyze scraped data☆46Updated 5 years ago