Basic setup to run ScrapyD + Django and save it in Django Models. You can be up and running in just a few minutes
☆125Feb 15, 2023Updated 3 years ago
Alternatives and similar repositories for Scrapyd-Django-Template
Users that are interested in Scrapyd-Django-Template are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Crawler is made by scrapy and server is made by django☆14Dec 8, 2022Updated 3 years ago
- Creating Scrapy scrapers via the Django admin interface☆1,158Feb 19, 2022Updated 4 years ago
- Scrapy Spiders Over Django Admin Dashboard – A Fork From Django-Dynamic-Scraper☆12May 26, 2020Updated 6 years ago
- A Python wrapper for working with Scrapyd's API.☆269Jul 31, 2024Updated last year
- Automatic unit test generation for Scrapy.☆58Jul 12, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,505Oct 29, 2024Updated last year
- Command line client for Scrapyd server☆773Feb 27, 2026Updated 4 months ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆560Dec 28, 2022Updated 3 years ago
- Snippets for MDB 5 Standard☆10Nov 21, 2022Updated 3 years ago
- A service daemon to run Scrapy spiders☆3,096Jun 19, 2026Updated last week
- Pre-built Scrapy spiders for AutoExtract☆19Apr 24, 2024Updated 2 years ago
- NOT MAINTAINED, use rest_condition instead.☆18Apr 8, 2014Updated 12 years ago
- Scrapy extension to write scraped items using Django models☆502Oct 15, 2023Updated 2 years ago
- A Dockerized Django setup☆24Nov 22, 2025Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆37Oct 27, 2016Updated 9 years ago
- Manage hosts (/etc/hosts) files from the command line. Supports presets (different static host mappings enabled at different times)☆13Nov 4, 2015Updated 10 years ago
- Scrapy+Splash for JavaScript integration☆3,231Feb 11, 2025Updated last year
- Python package for validating, parsing and generating unique citizenship numbers in Bulgaria EGN (ЕГН).☆11Apr 24, 2026Updated 2 months ago
- pipenv plugin for oh-my-zsh☆13Mar 15, 2018Updated 8 years ago
- admin ui for scrapy/open source scrapinghub☆22Dec 18, 2018Updated 7 years ago
- An image classification app built using Django 3, Django REST Framework 3, Next.js 12, and Material UI 5. The app uses Inception-ResNet-v…☆25Oct 12, 2025Updated 8 months ago
- Generic data backend for Kendo UI components☆24Mar 10, 2017Updated 9 years ago
- A sample repository to show to how to use django project with scrapy☆26Jul 29, 2022Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Backend, modern REST API for obtaining match and odds data crawled from multiple sites. Using FastAPI, MongoDB as database, Motor as asyn…☆61Dec 8, 2022Updated 3 years ago
- Creates a RSS file from a shared Google Drive folder☆14Jun 12, 2026Updated 2 weeks ago
- An awesome list that curates the best Flutter libraries, tools, tutorials, articles and more.☆10Jul 22, 2020Updated 5 years ago
- MkDocs plugin for minification using minify-html, an extremely fast and smart HTML + JS + CSS minifier.☆11Updated this week
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,409Feb 19, 2025Updated last year
- 🚃 The DjangoCon EU 2020 conference website☆16Feb 1, 2022Updated 4 years ago
- scrape prices from Amazon☆11Apr 17, 2016Updated 10 years ago
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆121Jun 4, 2024Updated 2 years ago
- A Scrapy pipeline module to persist items to a postgres table automatically.☆21Aug 14, 2017Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆11Jul 27, 2014Updated 11 years ago
- Official documentation of DHTMLX Suite☆14Updated this week
- This repository will allow users to create API requests from postman collections at scale.☆14Jun 11, 2026Updated 2 weeks ago
- Write Datasette canned queries as plain SQL files☆14Jul 2, 2022Updated 3 years ago
- 🙋♂️ 🙋 Use the best REST library with OAuth2 Social login. The simpliest DRF & JWT repo that allows you to extend your extended User mo…☆13Dec 8, 2022Updated 3 years ago
- Web interface for SMS Tools 3 that should works on OpenWrt.☆11May 23, 2015Updated 11 years ago
- Forward SMSs from android mobile to server☆10May 2, 2017Updated 9 years ago