A library to make it easier to load input URLs to start scrapy processes
☆14Feb 21, 2021Updated 5 years ago
Alternatives and similar repositories for spider-feeder
Users that are interested in spider-feeder are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Mar 8, 2025Updated last year
- Automatic unit test generation for Scrapy.☆57Jul 12, 2021Updated 4 years ago
- Library to populate items using XPath and CSS with a convenient API☆48Jan 29, 2026Updated last month
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Library for annotation-based dependency injection☆24Mar 3, 2026Updated 3 weeks ago
- 🕶 Awesome list of Scrapy tools and libraries☆61Jul 6, 2020Updated 5 years ago
- Generate OpenAPI 3.x.x using Pydantic☆11Feb 9, 2023Updated 3 years ago
- Automatizando consultas a veículos utilizando a base de dados do SINESP☆29Jul 6, 2019Updated 6 years ago
- Easy access to the OMDB Api☆13Feb 20, 2016Updated 10 years ago
- Scrapinghub Command Line Client☆130Nov 6, 2025Updated 4 months ago
- Common interface for data container classes☆68Mar 16, 2026Updated last week
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Mar 18, 2022Updated 4 years ago
- A scrapy extension to sync `.scrapy` folder to an S3 bucket☆18Mar 28, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- The most advanced debugging and testing tool for Scrapy☆16Apr 19, 2023Updated 2 years ago
- Web application to help categorize and aggregate subscriptions of media channels for easy access. (working only with Youtube channels at …☆16Aug 27, 2020Updated 5 years ago
- one liner `raise Exception if condition` for Python☆15Mar 22, 2017Updated 9 years ago
- Ultra light and minimalist Datepicker with zero dependencies.☆12Sep 27, 2017Updated 8 years ago
- A client interface for Scrapinghub's API☆205Updated this week
- Internationalization library. Easy and Fast.☆13Nov 10, 2022Updated 3 years ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Mar 13, 2026Updated last week
- Study materials for courses in the GA Tech OMSCS program.☆14Nov 5, 2023Updated 2 years ago
- Extract text from HTML☆135Feb 10, 2026Updated last month
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.☆11Aug 13, 2025Updated 7 months ago
- The Official Website™☆28Jan 1, 2013Updated 13 years ago
- Scrapy middleware which allows to crawl only new content☆80Feb 10, 2026Updated last month
- Python module that gives current information about orbital objects of interest☆12Dec 23, 2022Updated 3 years ago
- Next generation contract testing☆12Updated this week
- SCI1022 - Introduction to scientific coding☆11Mar 7, 2022Updated 4 years ago
- Web page preview and analysis tool☆12Jan 11, 2023Updated 3 years ago
- simple python gevent web spider☆23Jun 27, 2011Updated 14 years ago
- The Django Model Path Converter package dynamically creates custom path converters for you models.☆14Feb 15, 2023Updated 3 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- WebSocket library for Python (ws4py)☆13Apr 26, 2012Updated 13 years ago
- ☆11Apr 25, 2025Updated 11 months ago
- Go module for communicating with the Veryfi OCR API.☆24Sep 5, 2025Updated 6 months ago
- Scrapy Extension for monitoring spiders execution.☆552Mar 5, 2026Updated 3 weeks ago
- Düsseldorf Advanced Material Simulation Kit (DAMASK) "live plotter" for Jupyter☆10May 8, 2019Updated 6 years ago
- High dimensional numbers and reductions recipes for data visualization of scientific machine learning (SciML)☆15Jan 8, 2026Updated 2 months ago
- A package for representing VTK data types and manipulating them in Julia.☆10Sep 24, 2023Updated 2 years ago