acordiner / scrapy-dynamodb
AWS DynamoDB pipeline for Scrapy
☆21Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for scrapy-dynamodb
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆74Updated 2 years ago
- More flexible and featured Frontera scheduler for Scrapy☆35Updated 10 months ago
- Automatic unit test generation for Scrapy.☆55Updated 3 years ago
- Python3 interface to the LinkedIn API☆84Updated 4 years ago
- A guide/tutorial for running Scrapy with a serverless paradigm☆32Updated last year
- Python clients for Zyte AutoExtract API☆39Updated 2 years ago
- Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website☆42Updated 7 years ago
- Python interface to the LinkedIn API - V2☆57Updated 3 years ago
- Zyte Automatic Extraction integration for Scrapy☆55Updated 2 years ago
- JavaScript support and proxy rotation for Scrapy with ScrapingBee.☆36Updated 6 months ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 3 years ago
- Page Object pattern for Scrapy☆119Updated this week
- ☆23Updated 5 years ago
- Web scraping Page Objects core library☆95Updated last month
- Django Boilerplate Template for SaaS applications☆46Updated 7 months ago
- Ultimate Website Sitemap Parser☆181Updated last year
- An image resizing API with Python and Serverless framework☆22Updated 5 years ago
- Pipedrive wrapper written in Python☆50Updated 4 months ago
- Execute Scrapy spiders in a Flask web application☆64Updated 2 years ago
- Simple Scrapy middleware to process non-well-formed HTML with BeautifulSoup☆21Updated 8 years ago
- sample code for tech blog post "Porting Flask to FastAPI for ML Model Serving"☆29Updated last year
- Splash + HAProxy + Docker Compose☆198Updated 5 years ago
- Python Client for Metabase Rest Api☆79Updated last year
- Software stack with latest Scrapy and updated deps☆62Updated this week
- A client interface for Scrapinghub's API☆202Updated 10 months ago
- Collection of some examples using zappa, to be used for documentation as helpful working samples / tutorials.☆43Updated 9 months ago
- python wrapper for metabase api☆49Updated 3 years ago
- A Python DB-API and SQLAlchemy dialect to Google Spreasheets☆213Updated last year
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Updated 2 years ago
- Flask Dashboard - Argon Design | AppSeed☆157Updated 4 months ago