A library to make it easier to load input URLs to start scrapy processes
☆14Feb 21, 2021Updated 5 years ago
Alternatives and similar repositories for spider-feeder
Users that are interested in spider-feeder are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Analyze scraped data☆47Dec 9, 2019Updated 6 years ago
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- Library for annotation-based dependency injection☆24Oct 1, 2026Updated last month
- Automatic unit test generation for Scrapy.☆58Jul 12, 2021Updated 5 years ago
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Mar 8, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- Extract price amount and currency symbol from a raw text string☆348Updated this week
- A complimentary proxy to help to use SPM with headless browsers☆109Oct 20, 2026Updated 2 weeks ago
- Scrapy Extension for monitoring spiders execution.☆562Oct 20, 2026Updated 2 weeks ago
- Web scraping Page Objects core library☆107Oct 26, 2026Updated last week
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆75Mar 18, 2022Updated 4 years ago
- Page Object pattern for Scrapy☆129Oct 27, 2026Updated last week
- Nova versão do site da comunidade Python-MG☆16Jun 5, 2020Updated 6 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆110May 21, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆20Oct 23, 2026Updated last week
- Contains the common item definitions used in Zyte.☆10Oct 16, 2026Updated 2 weeks ago
- Common interface for data container classes☆70Updated this week
- A scrapy extension to sync `.scrapy` folder to an S3 bucket☆18Mar 28, 2022Updated 4 years ago
- The most advanced debugging and testing tool for Scrapy☆16Apr 19, 2023Updated 3 years ago
- Scrapy spider middleware to clean up query parameters in request URLs☆24Jun 30, 2016Updated 10 years ago
- Convert Javascript code to an XML document☆187Mar 14, 2022Updated 4 years ago
- ☆10Oct 22, 2018Updated 8 years ago
- one liner `raise Exception if condition` for Python☆15Mar 22, 2017Updated 9 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Scrapy extension which writes crawled items to Kafka☆31Apr 8, 2026Updated 6 months ago
- Web application to help categorize and aggregate subscriptions of media channels for easy access. (working only with Youtube channels at …☆16Aug 27, 2020Updated 6 years ago
- Annotate parts of web pages in the browser☆12Apr 8, 2026Updated 6 months ago
- Internationalization library. Easy and Fast.☆13Nov 10, 2022Updated 3 years ago
- Ultra light and minimalist Datepicker with zero dependencies.☆12Sep 27, 2017Updated 9 years ago
- simd enabled column imprints☆11Feb 12, 2018Updated 8 years ago
- Simple Scrapy middleware to process non-well-formed HTML with BeautifulSoup☆22Sep 26, 2016Updated 10 years ago
- 🌐CMS & API for InternetSemLimites☆17Feb 1, 2019Updated 7 years ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Apr 14, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Study materials for courses in the GA Tech OMSCS program.☆15Nov 5, 2023Updated 2 years ago
- Extract text from HTML☆135Apr 8, 2026Updated 6 months ago
- A Scrapy pipeline to categorize items using MonkeyLearn☆38Apr 28, 2017Updated 9 years ago
- Next generation contract testing☆12Oct 26, 2026Updated last week
- A simple command-line web crawler.☆13Feb 2, 2020Updated 6 years ago
- Pluggable DSL that uses pipes to perform a series of linear transformations to extract data☆16Jul 9, 2024Updated 2 years ago
- An online tool for annotating, filtering and diagnosing patients (Exome and Genome) with Mendelian Disorders.☆36Oct 18, 2026Updated 2 weeks ago