acordiner / scrapy-dynamodbLinks
AWS DynamoDB pipeline for Scrapy
☆22Updated 7 months ago
Alternatives and similar repositories for scrapy-dynamodb
Users that are interested in scrapy-dynamodb are comparing it to the libraries listed below
Sorting:
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Updated 3 years ago
- Python3 interface to the LinkedIn API☆84Updated 5 years ago
- Python Lambda Chrome Automation (naming pending)☆296Updated last year
- Python interface to the LinkedIn API - V2☆57Updated 4 years ago
- AWS Lambda precomiled binaries for lxml 3.6.4 built for python 2.7 and python 3.6 runtimes☆65Updated 6 years ago
- An example of a web scraper running on AWS Lambda and Lambda Layers☆137Updated 3 years ago
- A guide/tutorial for running Scrapy with a serverless paradigm☆33Updated 2 years ago
- Example app to be deployed to AWS as an API Gateway / Lambda Stack☆135Updated 4 years ago
- A Python DB-API and SQLAlchemy dialect to Google Spreasheets☆224Updated 2 years ago
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- Automatic unit test generation for Scrapy.☆57Updated 4 years ago
- A client interface for Scrapinghub's API☆205Updated last month
- Flask authentication with JWT against AWS Cognito☆96Updated last year
- A simple wrapper for boto3 for listening, and sending, to an AWS SQS queue☆156Updated last year
- Python API for interacting with the pipedrive.com API☆99Updated 6 years ago
- Ultimate Website Sitemap Parser☆229Updated this week
- Sample projects showcasing Scrapinghub tech☆138Updated last year
- DynamoDB integration for Flask.☆141Updated 3 years ago
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆122Updated last year
- Python Client for Metabase Rest Api☆80Updated 2 years ago
- Amazon Redshift SQLAlchemy Dialect☆223Updated last year
- Python wrapper for the Klaviyo API☆16Updated 2 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 4 years ago
- A daemon for scheduling Scrapy spiders☆66Updated 4 years ago
- Extract price amount and currency symbol from a raw text string☆341Updated 3 weeks ago
- JavaScript support and proxy rotation for Scrapy with ScrapingBee.☆38Updated last year
- Python address detector and parser☆212Updated last year
- Serverless selenium which dynamically execute any given code.☆63Updated 3 years ago
- ChartMogul API Python Client☆16Updated 2 months ago
- ⚡️ A fully-featured and blazing-fast Python API client to interact with Algolia.☆206Updated this week