Scrapy project template. Use it to quickly spin up a new web scraping project
☆16Nov 18, 2024Updated last year
Alternatives and similar repositories for scrapy-project-template
Users that are interested in scrapy-project-template are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collection of pipelines for Scrapy☆16Mar 13, 2026Updated last week
- In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framewor…☆12Feb 2, 2020Updated 6 years ago
- Enhanment Scrapping API for six hotel booking website from Expedia.com, Booking.com, Bookhotelbeds.com. Hotels.com, Bestday.com, despegar…☆11May 7, 2018Updated 7 years ago
- A library and command line tool utility to organise your media ( Photos and videos ) better☆16Nov 15, 2018Updated 7 years ago
- A decorator to write coroutine-like spider callbacks.☆109Dec 26, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Page Object pattern for Scrapy☆128Mar 15, 2026Updated last week
- The awful code behind the most beautiful torrent site to ever exist.☆11Jan 28, 2016Updated 10 years ago
- Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management☆17Sep 2, 2017Updated 8 years ago
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 5 years ago
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆21Feb 8, 2017Updated 9 years ago
- JAV site scrapers☆18Jul 6, 2022Updated 3 years ago
- Plex import agent using .nfo descriptor files as source.☆19Jan 19, 2023Updated 3 years ago
- Crawl your personal favorite images, photo albums, comics from website. Support pixiv, yande.re, x for now.☆23Sep 11, 2025Updated 6 months ago
- Scrapy project boilerplate done right☆48Feb 26, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- scrapy一个插件，绕过cloudflare检测，主要是封装 cloudscraper模块☆38May 5, 2021Updated 4 years ago
- A library with protocols needed to run a Mainline DHT node (written with Twisted)☆68Jan 16, 2014Updated 12 years ago
- ☆20Mar 10, 2024Updated 2 years ago
- The documentation partially maintained by the community for the StashBoxAPI☆34Mar 7, 2026Updated 2 weeks ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆39May 21, 2024Updated last year
- Use pyppeteer from a Scrapy spider☆59Feb 5, 2020Updated 6 years ago
- Native bindings to run python in its native interpreter.☆11May 19, 2017Updated 8 years ago
- Framework which helps you to make parallel/distributed calculations using data pipelines☆45Oct 22, 2020Updated 5 years ago
- 🕶 Awesome list of Scrapy tools and libraries☆61Jul 6, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- A Python command line argument to object parsing library for command line application development☆14Mar 23, 2016Updated 10 years ago
- uniapp 陀螺仪原生插件 https://ext.dcloud.net.cn/plugin?id=6237☆12Feb 22, 2022Updated 4 years ago
- Fluentd output plugin to Yandex ClickHouse.☆11Nov 8, 2017Updated 8 years ago
- NuGet package server powered by Lucene.Net.Linq☆62Aug 31, 2022Updated 3 years ago
- Python SDK Client for ZincSearch☆10Sep 21, 2022Updated 3 years ago
- Scrapy extension to write items using sqlalchemy models☆37Apr 24, 2017Updated 8 years ago
- A stand-alone gRPC based authentication API. Easily integrate authentication into any custom project. Authenticator takes care of user cr…☆14Jul 13, 2023Updated 2 years ago
- A proxy server in python, using tornado.☆12Apr 7, 2019Updated 6 years ago
- Simple Terminal Styling for Python☆11Mar 6, 2018Updated 8 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- nCoV疫情实时播报推送脚本。数据基于丁香园。☆53Aug 1, 2021Updated 4 years ago
- A set of PowerShell tools for working with type extensions.☆51Jun 25, 2025Updated 9 months ago
- 微信对话开放 平台小程序接入示例-末日生存游戏☆10Oct 25, 2019Updated 6 years ago
- ☆12Feb 4, 2025Updated last year
- multi-tendency base on xorm and gin☆11Jun 29, 2019Updated 6 years ago
- rsync on interval, via command line binary or docker container. Server and IOT builds for pull or push based device content management.☆23Oct 27, 2018Updated 7 years ago
- Collection of plugins for https://github.com/dongweiming/wechat-admin☆14Jul 24, 2017Updated 8 years ago