A client interface for Scrapinghub's API
☆205Oct 3, 2025Updated 4 months ago
Alternatives and similar repositories for python-scrapinghub
Users that are interested in python-scrapinghub are comparing it to the libraries listed below
Sorting:
- Scrapy entrypoint for Scrapinghub job runner☆26Updated this week
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- Deprecated HubStorage client library - please use python-scrapinghub>=1.9.0 instead☆16Dec 5, 2016Updated 9 years ago
- Analyze scraped data☆46Dec 9, 2019Updated 6 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- Scrapy Extension for monitoring spiders execution.☆553Updated this week
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Mar 8, 2025Updated 11 months ago
- Sample projects showcasing Scrapinghub tech☆138Feb 14, 2024Updated 2 years ago
- Extract embedded metadata from HTML markup☆951Oct 1, 2025Updated 4 months ago
- A scalable frontier for web crawlers☆1,328Jun 6, 2025Updated 8 months ago
- Software stack with latest Scrapy and updated deps☆65Feb 19, 2026Updated last week
- Crawlera tools☆26Feb 9, 2016Updated 10 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40May 21, 2024Updated last year
- A component that tries to avoid downloading duplicate content☆27Feb 10, 2026Updated 2 weeks ago
- Python library of web-related functions☆414Feb 19, 2026Updated last week
- ☆33Oct 20, 2025Updated 4 months ago
- Library to populate items using XPath and CSS with a convenient API☆47Jan 29, 2026Updated last month
- A middleware to use random user agent in Scrapy crawler.☆33Dec 15, 2012Updated 13 years ago
- Lightweight, scriptable browser as a service with an HTTP API☆4,199Aug 2, 2024Updated last year
- Convert Javascript code to an XML document☆187Mar 14, 2022Updated 3 years ago
- python parser for human readable dates☆2,785Feb 10, 2026Updated 2 weeks ago
- Scrapy Middleware to set a random User-Agent for every Request.☆202Aug 16, 2019Updated 6 years ago
- Scrapy Training companion code☆173Jan 30, 2019Updated 7 years ago
- JavaScript support and proxy rotation for Scrapy with ScrapingBee.☆39May 14, 2024Updated last year
- Zyte Automatic Extraction integration for Scrapy☆56Feb 4, 2022Updated 4 years ago
- Hook to manage.py to be able to start gevent WSGI server☆30Jan 26, 2015Updated 11 years ago
- A scrapy extension to sync `.scrapy` folder to an S3 bucket☆18Mar 28, 2022Updated 3 years ago
- Library for annotation-based dependency injection☆24Dec 9, 2025Updated 2 months ago
- A generic crawler☆78Feb 10, 2026Updated 2 weeks ago
- PyData Boston 2013 talks: "Intro to scikit-learn" & "Realtime Predictive Analytics: Using scikit-learn and RabbitMQ"☆11Jan 5, 2014Updated 12 years ago
- NER toolkit for HTML data☆259May 3, 2024Updated last year
- A small Django app for managing schedules☆13Dec 26, 2022Updated 3 years ago
- xlvector's solution of github contest☆33Aug 30, 2009Updated 16 years ago
- Skinfer is a tool for inferring and merging JSON schemas☆141Apr 24, 2024Updated last year
- Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors☆1,315Jan 29, 2026Updated last month
- Restrict crawl and scraping scope using matchers.☆26Jun 8, 2016Updated 9 years ago
- A scrapy extension to store requests and responses information in storage service☆27Mar 11, 2022Updated 3 years ago
- Random User-Agent middleware based on fake-useragent☆689Sep 18, 2023Updated 2 years ago
- ☆15Jan 21, 2026Updated last month