A library to make it easier to load input URLs to start scrapy processes
☆14Feb 21, 2021Updated 5 years ago
Alternatives and similar repositories for spider-feeder
Users that are interested in spider-feeder are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Analyze scraped data☆46Dec 9, 2019Updated 6 years ago
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Mar 8, 2025Updated last year
- Automatic unit test generation for Scrapy.☆57Jul 12, 2021Updated 4 years ago
- Library to populate items using XPath and CSS with a convenient API☆48Jan 29, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- Library for annotation-based dependency injection☆24Mar 3, 2026Updated last month
- 🕶 Awesome list of Scrapy tools and libraries☆61Jul 6, 2020Updated 5 years ago
- Generate OpenAPI 3.x.x using Pydantic☆11Feb 9, 2023Updated 3 years ago
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Jan 16, 2024Updated 2 years ago
- Extract price amount and currency symbol from a raw text string☆345Mar 19, 2026Updated 3 weeks ago
- A complimentary proxy to help to use SPM with headless browsers☆108May 29, 2023Updated 2 years ago
- Automatizando consultas a veículos utilizando a base de dados do SINESP☆29Jul 6, 2019Updated 6 years ago
- Conveniently collects Uber fare prices from a given origin and destination.☆12Jul 16, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Scrapinghub Command Line Client☆130Updated this week
- Common interface for data container classes☆68Mar 16, 2026Updated 3 weeks ago
- Auto generated swig python module with a binary compnent☆11Apr 19, 2012Updated 13 years ago
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Mar 18, 2022Updated 4 years ago
- A scrapy extension to sync `.scrapy` folder to an S3 bucket☆18Mar 28, 2022Updated 4 years ago
- Web scraping Page Objects core library☆105Apr 7, 2026Updated last week
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆109May 21, 2024Updated last year
- A linter for Scrapy projects.☆21Feb 25, 2026Updated last month
- Web application to help categorize and aggregate subscriptions of media channels for easy access. (working only with Youtube channels at …☆16Aug 27, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- one liner `raise Exception if condition` for Python☆15Mar 22, 2017Updated 9 years ago
- Ultra light and minimalist Datepicker with zero dependencies.☆12Sep 27, 2017Updated 8 years ago
- Read JSON lines (jl) files, including gzipped and broken☆36Apr 8, 2026Updated last week
- A client interface for Scrapinghub's API☆205Apr 7, 2026Updated last week
- Page Object pattern for Scrapy☆127Updated this week
- A project that aims to store historical data from the Philippine Stock Exchange(PSE) and make it available to the public through a REST A…☆11Dec 7, 2022Updated 3 years ago
- Internationalization library. Easy and Fast.☆13Nov 10, 2022Updated 3 years ago
- A simple command-line web crawler.☆13Feb 2, 2020Updated 6 years ago
- Extract text from HTML☆135Apr 7, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An infrastructure agnostic CI build radiator☆43Nov 16, 2018Updated 7 years ago
- Propostas, discussões e decisões relacionadas à comunidade.☆19Oct 1, 2018Updated 7 years ago
- Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.☆11Aug 13, 2025Updated 8 months ago
- The Official Website™☆28Jan 1, 2013Updated 13 years ago
- A JupyterHub authenticator using Kerberos☆12Jul 16, 2019Updated 6 years ago
- Performance-focused replacement for Python urllib☆21Oct 2, 2018Updated 7 years ago
- Python module that gives current information about orbital objects of interest☆12Dec 23, 2022Updated 3 years ago