acordiner / scrapy-dynamodbLinks
AWS DynamoDB pipeline for Scrapy
☆22Updated 9 months ago
Alternatives and similar repositories for scrapy-dynamodb
Users that are interested in scrapy-dynamodb are comparing it to the libraries listed below
Sorting:
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Updated 3 years ago
- Python Lambda Chrome Automation (naming pending)☆295Updated last year
- An example of a web scraper running on AWS Lambda and Lambda Layers☆138Updated 3 years ago
- Python interface to the LinkedIn API - V2☆57Updated 4 years ago
- Python3 interface to the LinkedIn API☆84Updated 5 years ago
- A client interface for Scrapinghub's API☆205Updated 2 months ago
- Serverless selenium which dynamically execute any given code.☆64Updated 3 years ago
- A Python DB-API and SQLAlchemy dialect to Google Spreasheets☆224Updated 3 years ago
- A guide/tutorial for running Scrapy with a serverless paradigm☆33Updated 2 years ago
- A simple wrapper for boto3 for listening, and sending, to an AWS SQS queue☆156Updated last year
- Python clients for Zyte AutoExtract API☆41Updated 3 years ago
- ☆130Updated last week
- AWS Lambda precomiled binaries for lxml 3.6.4 built for python 2.7 and python 3.6 runtimes☆65Updated 6 years ago
- Automatic unit test generation for Scrapy.☆57Updated 4 years ago
- Selenium UI testing with AWS Lambda Layers☆86Updated 5 years ago
- DynamoDB integration for Flask.☆141Updated 3 weeks ago
- A job scraper using the Scrapy framework☆16Updated 8 years ago
- Low level, multiprocessing based AWS Kinesis producer & consumer library☆123Updated last year
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 4 years ago
- A complimentary proxy to help to use SPM with headless browsers☆108Updated 2 years ago
- Flask authentication with JWT against AWS Cognito☆96Updated last year
- Read/write Google spreadsheets using pandas DataFrames☆258Updated 8 months ago
- ☆68Updated 7 years ago
- Sample projects showcasing Scrapinghub tech☆138Updated last year
- The hassle-free way to integrate analytics into any python application.☆254Updated 3 weeks ago
- Run Pandas/Numpy in AWS Lambda python 3.6 environment.☆74Updated 8 years ago
- Extract price amount and currency symbol from a raw text string☆345Updated 2 months ago
- A Scrapy middleware to bypass the CloudFlare's anti-bot protection☆111Updated 4 years ago
- Splash + HAProxy + Docker Compose☆197Updated 7 years ago
- Seamlessly serve your static assets of your Flask app from Amazon S3☆200Updated 2 years ago