Automatic unit test generation for Scrapy.
☆57Jul 12, 2021Updated 4 years ago
Alternatives and similar repositories for scrapy-autounit
Users that are interested in scrapy-autounit are comparing it to the libraries listed below
Sorting:
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 5 years ago
- Scrapy Extension for monitoring spiders execution.☆551Updated this week
- Library to populate items using XPath and CSS with a convenient API☆47Jan 29, 2026Updated last month
- Remove DIVs, style stuff and normalize HTML preserving structure information☆14Oct 24, 2025Updated 4 months ago
- Scrapy extension which writes crawled items to Kafka☆30Feb 10, 2026Updated 3 weeks ago
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Jan 16, 2024Updated 2 years ago
- Show summary of a large number of URLs in a Jupyter Notebook☆17Feb 10, 2026Updated 3 weeks ago
- Formasaurus tells you the type of an HTML form and its fields using machine learning☆120Feb 23, 2026Updated 2 weeks ago
- Detect and classify pagination links☆15Sep 9, 2020Updated 5 years ago
- Web app to automate finding a laptop using Django, Scrapy, Celery, Mailgun☆13Dec 8, 2022Updated 3 years ago
- A complimentary proxy to help to use SPM with headless browsers☆107May 29, 2023Updated 2 years ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Jan 14, 2026Updated last month
- Sentry component for Scrapy☆86Aug 21, 2023Updated 2 years ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆558Dec 28, 2022Updated 3 years ago
- Modular, way of implementing rate-limiting in python with a few handy default implementations☆64Mar 27, 2023Updated 2 years ago
- Pyppeteer integration for Scrapy☆58Feb 26, 2021Updated 5 years ago
- Scrapy stats exporter for prometheus☆22Aug 22, 2025Updated 6 months ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Oct 19, 2019Updated 6 years ago
- A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them☆74Jan 30, 2023Updated 3 years ago
- internal API for call processing☆11Feb 19, 2026Updated 2 weeks ago
- Labs AZ-104 Azure Administrator☆19Jun 15, 2020Updated 5 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆110May 21, 2024Updated last year
- ☆29Apr 28, 2021Updated 4 years ago
- Convert Javascript code to an XML document☆187Mar 14, 2022Updated 3 years ago
- Read JSON lines (jl) files, including gzipped and broken☆36Feb 10, 2026Updated 3 weeks ago
- Spider templates for automatic crawlers.☆34Jan 8, 2026Updated 2 months ago
- A pure-Python robots.txt parser with support for modern conventions.☆85Jan 29, 2026Updated last month
- More flexible and featured Frontera scheduler for Scrapy☆36Jun 6, 2025Updated 9 months ago
- Basic setup to run ScrapyD + Django and save it in Django Models. You can be up and running in just a few minutes☆126Feb 15, 2023Updated 3 years ago
- Basic system identification ('machine learning') and image processing ('machine vision') algorithms☆14Feb 11, 2026Updated 3 weeks ago
- My main collection, containing all important roles for my daily work.☆11Updated this week
- This project is the backend engine for a fully autonomous AI-powered call center. It integrates a large language model (LLM), speech reco…☆21Apr 18, 2025Updated 10 months ago
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Mar 18, 2022Updated 3 years ago
- Extract price amount and currency symbol from a raw text string☆347Feb 12, 2026Updated 3 weeks ago
- Automation tool for testing C* OSS that assembles cassandra-diff, nosqlbench, fqltool☆11Mar 20, 2023Updated 2 years ago
- Scanning in the middlelayer, v2☆10Feb 18, 2026Updated 2 weeks ago
- Java-like application properties in Python☆18Mar 8, 2023Updated 3 years ago
- Line of business tooling for VOIP services.☆11Feb 22, 2026Updated 2 weeks ago
- A simple provisioning web app for jambonz☆12Feb 12, 2026Updated 3 weeks ago