Basic setup to run ScrapyD + Django and save it in Django Models. You can be up and running in just a few minutes
☆126Feb 15, 2023Updated 3 years ago
Alternatives and similar repositories for Scrapyd-Django-Template
Users that are interested in Scrapyd-Django-Template are comparing it to the libraries listed below
Sorting:
- Creating Scrapy scrapers via the Django admin interface☆1,163Feb 19, 2022Updated 4 years ago
- The ultimate Django template: production ready Django 4.1 with Docker, HTTPS and CI/CD using Github actions ️🔥☆43Dec 2, 2022Updated 3 years ago
- A Python wrapper for working with Scrapyd's API.☆271Jul 31, 2024Updated last year
- Automatic unit test generation for Scrapy.☆57Jul 12, 2021Updated 4 years ago
- TaxTea 🐸 ☕️ - Django app that calculates tax rates for SaaS products☆19Jul 2, 2024Updated last year
- Scrapy Extension for monitoring spiders execution.☆551Updated this week
- Pre-built Scrapy spiders for AutoExtract☆19Apr 24, 2024Updated last year
- A Scrapy pipeline module to persist items to a postgres table automatically.☆21Aug 14, 2017Updated 8 years ago
- admin ui for scrapy/open source scrapinghub☆22Dec 18, 2018Updated 7 years ago
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,501Oct 29, 2024Updated last year
- ☆12Feb 24, 2026Updated last week
- FastAPI middleware that provides seamless two-factor authentication implementation. It integrates with FastAPI to offer robust 2FA protec…☆34Nov 30, 2025Updated 3 months ago
- High Performance Python Django pagination☆35Feb 8, 2020Updated 6 years ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆558Dec 28, 2022Updated 3 years ago
- A service daemon to run Scrapy spiders☆3,085Mar 2, 2026Updated last week
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,405Feb 19, 2025Updated last year
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆121Jun 4, 2024Updated last year
- Scrapy+Splash for JavaScript integration☆3,239Feb 11, 2025Updated last year
- ☆10Feb 25, 2021Updated 5 years ago
- Convert excel sheet to SEO friendly sitemaps!☆12Dec 8, 2022Updated 3 years ago
- Detecting Radiological Threats in Urban Areas (9th place solution)☆10May 4, 2019Updated 6 years ago
- This project is the backend engine for a fully autonomous AI-powered call center. It integrates a large language model (LLM), speech reco…☆21Apr 18, 2025Updated 10 months ago
- Infinite scroll is an opinionated way for endless pagination☆18Jan 7, 2014Updated 12 years ago
- My main collection, containing all important roles for my daily work.☆11Updated this week
- A simple version of the MAX Object Detector Web App rewritten in python for use in the MAX tutorial☆10Mar 31, 2021Updated 4 years ago
- A sample repository to show to how to use django project with scrapy☆26Jul 29, 2022Updated 3 years ago
- Build best practiced apis fast with Python3☆1,603Dec 11, 2025Updated 2 months ago
- Automation tool for testing C* OSS that assembles cassandra-diff, nosqlbench, fqltool☆11Mar 20, 2023Updated 2 years ago
- A simple provisioning web app for jambonz☆12Feb 12, 2026Updated 3 weeks ago
- A set of scripts to gather and analyze NMEA data; it uses Python so it's easy to customize☆10Jun 18, 2017Updated 8 years ago
- Unofficial armhf build of wazo-platform☆11May 5, 2020Updated 5 years ago
- Ansible Collection for managing Infrahub☆15Updated this week
- Refactoring and upgrade of AllStarLink's app_rpt, etc.☆11Updated this week
- Working example to integrate Midtrans payment gateway with Django☆10Apr 27, 2021Updated 4 years ago
- The best WeasyPrint container that exists on the web.☆11Sep 29, 2022Updated 3 years ago
- A wrapper of "pluggy" to support asyncio and context managers☆13Feb 17, 2026Updated 3 weeks ago
- Line of business tooling for VOIP services.☆11Feb 22, 2026Updated 2 weeks ago
- The 14th National College Student Information Security Competition Entry: "Sina Weibo Rumor Detection System"☆11Oct 25, 2022Updated 3 years ago
- Website for www.ambitionfund.org, micro-grant program to provide support for underrepresented people who need financial assistance pursui…☆13Jan 6, 2023Updated 3 years ago