Simple Web UI for Scrapy spider management via Scrapyd
☆50Jun 25, 2018Updated 7 years ago
Alternatives and similar repositories for scrapymon
Users that are interested in scrapymon are comparing it to the libraries listed below
Sorting:
- Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner☆112May 11, 2018Updated 7 years ago
- Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management☆17Sep 2, 2017Updated 8 years ago
- admin ui for scrapy/open source scrapinghub☆22Dec 18, 2018Updated 7 years ago
- admin ui for scrapy/open source scrapinghub☆2,778May 4, 2023Updated 2 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 4 years ago
- ☆19Jun 15, 2017Updated 8 years ago
- admin ui for scrapy/open source scrapinghub☆58Apr 28, 2021Updated 4 years ago
- ☆10Aug 2, 2019Updated 6 years ago
- A Python wrapper for working with Scrapyd's API.☆271Jul 31, 2024Updated last year
- Python 3 AsyncIO powered scraping framework with batteries included☆20Sep 8, 2016Updated 9 years ago
- scrapy-ui☆16Feb 21, 2014Updated 12 years ago
- Command line client for Scrapyd server☆778Feb 27, 2026Updated last week
- Paste in some broken unicode text and FTFY will tell you how to fix it!☆70Feb 14, 2023Updated 3 years ago
- Interfaces and shared infrastructure for generic task processing at Yelp.☆23Sep 4, 2025Updated 6 months ago
- Scrapy entrypoint for Scrapinghub job runner☆26Feb 26, 2026Updated last week
- A hybrid Java/Python desktop app that collects regional Uber/Lyft driver information in real-time☆10Sep 16, 2017Updated 8 years ago
- LVCS@Tesla.com☆12Jan 16, 2026Updated last month
- FastAPI, SQLAlchemy, aio_pika, RabbitMQ and Docker boilerplate☆29Apr 4, 2023Updated 2 years ago
- Code samples used in the blog post "How to Integrate Highcharts.js with Django"☆29Apr 4, 2018Updated 7 years ago
- Software stack with latest Scrapy and updated deps☆65Feb 19, 2026Updated 2 weeks ago
- A Web Application of Vegetable Sales using Association Rules☆11Nov 1, 2018Updated 7 years ago
- internal API for call processing☆11Feb 19, 2026Updated 2 weeks ago
- Project for Alike Backup, a BDR solution for XenServer, XCP-ng, and Hyper-V virtualization platforms☆12Sep 18, 2024Updated last year
- Analyze Emails☆11Dec 8, 2022Updated 3 years ago
- This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.☆1,231Nov 7, 2023Updated 2 years ago
- Web Crawling UI and HTTP API, based on Scrapy and Tornado☆160Feb 10, 2026Updated 3 weeks ago
- A daemon for scheduling Scrapy spiders☆66May 28, 2021Updated 4 years ago
- A Scrapy crawler for http://books.toscrape.com☆27May 26, 2017Updated 8 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆277Feb 26, 2025Updated last year
- Scrapy middleware which allows to crawl only new content☆79Feb 10, 2026Updated 3 weeks ago
- Microsoft DevBox Demos☆10Updated this week
- This project is the backend engine for a fully autonomous AI-powered call center. It integrates a large language model (LLM), speech reco…☆21Apr 18, 2025Updated 10 months ago
- My main collection, containing all important roles for my daily work.☆11Updated this week
- ☆12Sep 2, 2024Updated last year
- 💻 CLI for reporting events to Faros platform☆14Jan 30, 2026Updated last month
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 11 years ago
- Scrapy extension to control spiders using JSON-RPC☆300Aug 26, 2019Updated 6 years ago
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Mar 18, 2022Updated 3 years ago
- How to Use Chart.js with Django☆40Sep 22, 2021Updated 4 years ago