A daemon for scheduling Scrapy spiders
☆66May 28, 2021Updated 4 years ago
Alternatives and similar repositories for scrapy-do
Users that are interested in scrapy-do are comparing it to the libraries listed below
Sorting:
- A scrapy extension to sync `.scrapy` folder to an S3 bucket☆18Mar 28, 2022Updated 3 years ago
- Docker container running scrapyd with HTTP authentication☆41May 14, 2024Updated last year
- Basic functionality for every site☆12Jan 4, 2022Updated 4 years ago
- A list of awesome project for Ruia☆13Aug 24, 2022Updated 3 years ago
- A curated set of AI and Data Science tutorials in Python - fully revised by me and ready to run!☆14Mar 3, 2025Updated last year
- admin ui for scrapy/open source scrapinghub☆58Apr 28, 2021Updated 4 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆57Mar 16, 2022Updated 3 years ago
- SearchGar - An actual Search Engine made using Python☆18Sep 1, 2022Updated 3 years ago
- Cordova Android TV Plugin☆19Jul 30, 2021Updated 4 years ago
- Scrapy Extension for monitoring spiders execution.☆551Updated this week
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- Scrapy middleware to handle javascript pages using selenium☆958Jul 8, 2024Updated last year
- Pre-built Scrapy spiders for AutoExtract☆19Apr 24, 2024Updated last year
- HTTP API for Scrapy spiders☆881Feb 16, 2026Updated 3 weeks ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆110May 21, 2024Updated last year
- A middleware layer for Scrapy that detects CAPTCHA tests and solves them☆44Jul 6, 2023Updated 2 years ago
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆121Jun 4, 2024Updated last year
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Mar 18, 2022Updated 3 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 7 years ago
- A decorator to write coroutine-like spider callbacks.☆109Dec 26, 2022Updated 3 years ago
- Scrapy entrypoint for Scrapinghub job runner☆26Feb 26, 2026Updated last week
- A Cordova plugin to handle the HTML5 gamepad API for iOS and Android☆21Oct 18, 2014Updated 11 years ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,405Feb 19, 2025Updated last year
- Page Object pattern for Scrapy☆127Jan 28, 2026Updated last month
- internal API for call processing☆11Feb 19, 2026Updated 2 weeks ago
- ☆29Apr 17, 2018Updated 7 years ago
- A service daemon to run Scrapy spiders☆3,085Mar 2, 2026Updated last week
- Common interface for data container classes☆68Feb 23, 2026Updated 2 weeks ago
- admin ui for scrapy/open source scrapinghub☆2,778May 4, 2023Updated 2 years ago
- scripts to cut mesh / rigid bodies in godot at runtime implemented in GDscript☆32Dec 5, 2021Updated 4 years ago
- The MCP Strava Server facilitates seamless integration between Strava APIs and Claude for Desktop.☆16Updated this week
- Structure and Interpretation of Computer Programs☆13Oct 8, 2016Updated 9 years ago
- A CLI for benchmarking Scrapy.☆32Jun 28, 2025Updated 8 months ago
- Python package that allows developers to convert Ethereum smart contract ABIs into interactive HTML user interface.☆17Aug 6, 2023Updated 2 years ago
- simd enabled column imprints☆11Feb 12, 2018Updated 8 years ago
- This project is the backend engine for a fully autonomous AI-powered call center. It integrates a large language model (LLM), speech reco…☆21Apr 18, 2025Updated 10 months ago
- COCO, Analytics, Website, LOOP, Training, IVR, Helpline☆13Jun 22, 2025Updated 8 months ago
- A collection of packages for interacting with EVM smart contracts using pydantic for type safety☆11Nov 5, 2025Updated 4 months ago
- Hugo SEO Module☆10Jan 7, 2026Updated 2 months ago