Small set of utilities to simplify writing Scrapy spiders.
☆50Jul 24, 2015Updated 10 years ago
Alternatives and similar repositories for scrapy-boilerplate
Users that are interested in scrapy-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A helper to create web scrapers using scrapy selector in a Model based structure☆57Dec 26, 2022Updated 3 years ago
- Paginating the web☆37Feb 11, 2014Updated 12 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- Hawk HTTP Authorization for Django Rest Framework☆19Jul 28, 2020Updated 5 years ago
- Using multiple spiders in a Scrapy project☆10Aug 7, 2015Updated 10 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 基于Python Flask框架的又拍云管理工具☆16Dec 9, 2016Updated 9 years ago
- Clarify your words with emojis☆12Aug 25, 2016Updated 9 years ago
- ☆143Nov 24, 2015Updated 10 years ago
- Utility to re-structure research papers published in US Letter or A4 format PDF files to typically remove the 2 columns layout.☆53Nov 8, 2010Updated 15 years ago
- A scrapy extension to store requests and responses information in storage service☆27Mar 11, 2022Updated 4 years ago
- A decorator to write coroutine-like spider callbacks.☆109Dec 26, 2022Updated 3 years ago
- Backup Feishu documents to Markdown☆21Mar 10, 2025Updated last year
- extension for fabric to handle prompts through pexpect☆44May 31, 2015Updated 10 years ago
- Restrict crawl and scraping scope using matchers.☆26Jun 8, 2016Updated 9 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Updated this week
- A useful opinionated repository of Artificial Intelligence ecosystem resources - AI event calendars, papers, books, articles, videos, AI …☆20Mar 1, 2026Updated last month
- ModelXplore, a python based model exploration☆16Jun 1, 2018Updated 7 years ago
- Crochet-based blocking API for Scrapy.☆47Feb 24, 2017Updated 9 years ago
- Expiry rules for Django sessions☆22Jul 17, 2020Updated 5 years ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 11 years ago
- NER toolkit for HTML data☆259May 3, 2024Updated last year
- Infobip SMS plugin for Mautic 2.8.1+☆11Apr 23, 2021Updated 4 years ago
- Alternative implementation of django "sites" framework based on settings instead of models.☆24Dec 7, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Python package that provides dispatch on values using pattern matching☆18Aug 18, 2017Updated 8 years ago
- A scrapy pipeline which send items to Elastic Search server☆98Jan 2, 2018Updated 8 years ago
- Django Composite Multiple PrimaryKey☆75Oct 11, 2014Updated 11 years ago
- Taiga Importer API Client☆22May 26, 2015Updated 10 years ago
- Find which links on a web page are pagination links☆29Jan 12, 2017Updated 9 years ago
- A transparent layer for full-text search using Sphinx and Django☆17Feb 7, 2012Updated 14 years ago
- An R package for assembling data frames from HTML tables (fka htmltable)☆26Oct 27, 2018Updated 7 years ago
- ☆14Sep 17, 2024Updated last year
- Push stunnel into your buildpack to enable you to create secure client connections out to other resources.☆10Feb 18, 2015Updated 11 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Weibo Spider☆48Apr 29, 2017Updated 8 years ago
- A Scrapy pipeline to categorize items using MonkeyLearn☆38Apr 28, 2017Updated 8 years ago
- 📸 A lightweight and universal Instagram API client☆11Jan 12, 2023Updated 3 years ago
- PacketZoom SDK for React Native☆11Sep 21, 2018Updated 7 years ago
- ADS-B Meta Tracker tracks meta data for ADS-B tracker.☆13Mar 7, 2023Updated 3 years ago
- Exports a list of links, filtered by at least one tag, from a Pinboard account. Currently supports HTML, Markdown, Textile, MediaWiki-mar…☆16Jun 3, 2014Updated 11 years ago
- ☆14Feb 14, 2026Updated 2 months ago