Basic setup to run ScrapyD + Django and save it in Django Models. You can be up and running in just a few minutes
☆125Feb 15, 2023Updated 3 years ago
Alternatives and similar repositories for Scrapyd-Django-Template
Users that are interested in Scrapyd-Django-Template are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Crawler is made by scrapy and server is made by django☆13Dec 8, 2022Updated 3 years ago
- Scrapy Spiders Over Django Admin Dashboard – A Fork From Django-Dynamic-Scraper☆12May 26, 2020Updated 6 years ago
- Automatic unit test generation for Scrapy.☆58Jul 12, 2021Updated 5 years ago
- A Python wrapper for working with Scrapyd's API.☆270Jul 31, 2024Updated 2 years ago
- ☆14Feb 24, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scrapy extension to write scraped items using Django models☆502Oct 15, 2023Updated 3 years ago
- Scrapy Extension for monitoring spiders execution.☆564Oct 20, 2026Updated last month
- Command line client for Scrapyd server☆773Feb 27, 2026Updated 8 months ago
- ☆11Jun 27, 2017Updated 9 years ago
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,518Jul 4, 2026Updated 4 months ago
- A service daemon to run Scrapy spiders☆3,100Oct 23, 2026Updated 3 weeks ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆563Dec 28, 2022Updated 3 years ago
- Pre-built Scrapy spiders for AutoExtract☆18Apr 24, 2024Updated 2 years ago
- Manage hosts (/etc/hosts) files from the command line. Supports presets (different static host mappings enabled at different times)☆13Nov 4, 2015Updated 11 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Dockerized Django setup☆24Nov 22, 2025Updated 11 months ago
- Python slack bot for handling new members☆15Oct 1, 2018Updated 8 years ago
- Scrapy+Splash for JavaScript integration☆3,224Feb 11, 2025Updated last year
- A django admin site for scrapy☆45Nov 1, 2017Updated 9 years ago
- Fetch data from Tableau into a SQLite database☆13Jul 29, 2021Updated 5 years ago
- admin ui for scrapy/open source scrapinghub☆22Dec 18, 2018Updated 7 years ago
- A sample repository to show to how to use django project with scrapy☆26Jul 29, 2022Updated 4 years ago
- 🚃 The DjangoCon EU 2020 conference website☆16Feb 1, 2022Updated 4 years ago
- A Scrapy pipeline module to persist items to a postgres table automatically.☆21Aug 14, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Testcase classes and assertions for testing processes.☆10Jul 3, 2024Updated 2 years ago
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆121Jun 4, 2024Updated 2 years ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,412Feb 19, 2025Updated last year
- Gulp plugin for building graph of angular modules relations☆10Sep 19, 2018Updated 8 years ago
- pipenv plugin for oh-my-zsh☆13Mar 15, 2018Updated 8 years ago
- 🙋♂️ 🙋 Use the best REST library with OAuth2 Social login. The simpliest DRF & JWT repo that allows you to extend your extended User mo…☆13Dec 8, 2022Updated 3 years ago
- Official documentation of DHTMLX Suite☆14Updated this week
- A Free Database of Legal Materials☆32Feb 17, 2020Updated 6 years ago
- Vue-Phoenix is a Phoenix integration for Vuejs.☆12Feb 4, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scrapy Deployed on AWS Lambda☆11Sep 8, 2022Updated 4 years ago
- An OAuth2 demo introduces how to setup OAuth client with Python Django.☆10Feb 8, 2023Updated 3 years ago
- Link sharing application built with clean architecture in mind☆18May 28, 2018Updated 8 years ago
- use multiple proxies with Scrapy☆772Apr 8, 2026Updated 7 months ago
- VPS/Dedicated Server setup for running WordPress on Nginx & PHP-FPM☆12Dec 22, 2013Updated 12 years ago
- Scrapy middleware for building historical S3 cache for crawled web resources.☆10Jun 21, 2017Updated 9 years ago
- NOT MAINTAINED, use rest_condition instead.☆18Apr 8, 2014Updated 12 years ago
Are these results useful?