Common interface for data container classes
☆68Feb 23, 2026Updated last week
Alternatives and similar repositories for itemadapter
Users that are interested in itemadapter are comparing it to the libraries listed below
Sorting:
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Jan 16, 2024Updated 2 years ago
- Library to populate items using XPath and CSS with a convenient API☆47Jan 29, 2026Updated last month
- A pure-Python robots.txt parser with support for modern conventions.☆85Jan 29, 2026Updated last month
- Page Object pattern for Scrapy☆127Jan 28, 2026Updated last month
- Spider templates for automatic crawlers.☆34Jan 8, 2026Updated last month
- Library for annotation-based dependency injection☆24Dec 9, 2025Updated 2 months ago
- Zyte API integration for Scrapy☆40Feb 16, 2026Updated 2 weeks ago
- Extract text from HTML☆134Feb 10, 2026Updated 3 weeks ago
- A component that tries to avoid downloading duplicate content☆27Feb 10, 2026Updated 3 weeks ago
- Workflow management system written as a pure Python package and command-line utility. It supports complex workflows modeled as directed- …☆16Jan 28, 2025Updated last year
- Robot exclusion protocol in C++☆12Jul 26, 2024Updated last year
- A library to make it easier to load input URLs to start scrapy processes☆14Feb 21, 2021Updated 5 years ago
- a lazy-loading, fancy-sliceable iterable☆18Jun 30, 2025Updated 8 months ago
- Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors☆1,317Jan 29, 2026Updated last month
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆57Mar 16, 2022Updated 3 years ago
- Web scraping Page Objects core library☆104Jan 27, 2026Updated last month
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 5 years ago
- A computation graph micro-framework providing seamless lazy and concurrent evaluation☆16Feb 14, 2020Updated 6 years ago
- Python client for Zyte API☆28Feb 10, 2026Updated 3 weeks ago
- WebThings framework.☆20Nov 25, 2022Updated 3 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆110May 21, 2024Updated last year
- Template starter for Django + Inertia.js + Svelte.☆20Jun 5, 2023Updated 2 years ago
- agate-sql adds SQL read/write support to agate.☆18Updated this week
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆121Jun 4, 2024Updated last year
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 4 years ago
- 🎭 Playwright integration for Scrapy☆1,368Jan 21, 2026Updated last month
- Scrapy entrypoint for Scrapinghub job runner☆26Updated this week
- 🕶 Awesome list of Scrapy tools and libraries☆61Jul 6, 2020Updated 5 years ago
- A scrapy extension to store requests and responses information in storage service☆27Mar 11, 2022Updated 3 years ago
- Extendable Qt widget to display and edit JSON-serializable data☆29Sep 12, 2023Updated 2 years ago
- admin ui for scrapy/open source scrapinghub☆58Apr 28, 2021Updated 4 years ago
- Declarative request parsing and validation for Starlette with webargs☆39Dec 4, 2022Updated 3 years ago
- Email delivery for asyncio.☆27Dec 16, 2024Updated last year
- Scrapy spider middleware to clean up query parameters in request URLs☆24Jun 30, 2016Updated 9 years ago
- Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python☆293Jan 29, 2026Updated last month
- Extract embedded metadata from HTML markup☆951Oct 1, 2025Updated 5 months ago
- Random User-Agent middleware based on fake-useragent☆690Sep 18, 2023Updated 2 years ago
- The easy way of handling Django secrets.☆26Feb 3, 2026Updated last month
- internal API for call processing☆11Feb 19, 2026Updated 2 weeks ago