Small set of utilities to simplify writing Scrapy spiders.
☆50Jul 24, 2015Updated 10 years ago
Alternatives and similar repositories for scrapy-boilerplate
Users that are interested in scrapy-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A helper to create web scrapers using scrapy selector in a Model based structure☆57Dec 26, 2022Updated 3 years ago
- Paginating the web☆37Feb 11, 2014Updated 12 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- Hawk HTTP Authorization for Django Rest Framework☆19Jul 28, 2020Updated 5 years ago
- ☆143Nov 24, 2015Updated 10 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 在这里，快速简单的发现群里的共 同空闲时间，解决哪天约的千古难题，让群约更简单。☆17Sep 20, 2020Updated 5 years ago
- A decorator to write coroutine-like spider callbacks.☆109Dec 26, 2022Updated 3 years ago
- Detect and classify pagination links☆15Sep 9, 2020Updated 5 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆57Mar 16, 2022Updated 4 years ago
- extension for fabric to handle prompts through pexpect☆44May 31, 2015Updated 10 years ago
- Restrict crawl and scraping scope using matchers.☆26Jun 8, 2016Updated 9 years ago
- Pre-built Scrapy spiders for AutoExtract☆19Apr 24, 2024Updated last year
- ☆68Sep 7, 2018Updated 7 years ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 11 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- NER toolkit for HTML data☆259May 3, 2024Updated last year
- Python package that provides dispatch on values using pattern matching☆18Aug 18, 2017Updated 8 years ago
- A scrapy pipeline which send items to Elastic Search server☆98Jan 2, 2018Updated 8 years ago
- HTTPS client implementation for httplib and urllib2 based on PyOpenSSL☆19Mar 19, 2021Updated 5 years ago
- A Ruby gem that calculates Gematria☆10Mar 15, 2013Updated 13 years ago
- Find which links on a web page are pagination links☆29Jan 12, 2017Updated 9 years ago
- [ НЕ ПОДДЕРЖИВАЕТСЯ. ПИШИТЕ НА kmike84@gmail.com, ЕСЛИ ХОТИТЕ ПОМОЧЬ ] Библиотека для работы с API Яндекс-карт.☆17Aug 28, 2016Updated 9 years ago
- ☆14Sep 17, 2024Updated last year
- Push stunnel into your buildpack to enable you to create secure client connections out to other resources.☆10Feb 18, 2015Updated 11 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- A python library detect and extract listing data from HTML page.☆109May 5, 2017Updated 8 years ago
- A Scrapy pipeline to categorize items using MonkeyLearn☆38Apr 28, 2017Updated 8 years ago
- Mautic email templates☆15Mar 25, 2017Updated 9 years ago
- Webrecorders DevTools Protocol Automation Library☆18Oct 18, 2022Updated 3 years ago
- ☆15Feb 14, 2026Updated last month
- PyData Boston 2013 talks: "Intro to scikit-learn" & "Realtime Predictive Analytics: Using scikit-learn and RabbitMQ"☆11Jan 5, 2014Updated 12 years ago
- A scrapy zhihu crawler☆77Nov 6, 2018Updated 7 years ago
- Another Loan Fintech API☆10Jan 16, 2025Updated last year
- Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)☆33Feb 22, 2018Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- CDNStat is a daemon collecting various statistics from nginx requests: request count, sent bytes, referer, URI path.☆28Sep 22, 2012Updated 13 years ago
- Firefly III example script to manage auto-save transactions created by your bank☆13Apr 18, 2024Updated last year
- Vast-ai public repository for open sourced tools, plugins, etc.☆16Nov 4, 2024Updated last year
- Tidy, clean and prettify your HTML code with this plugin for Sublime Text 2☆89Nov 20, 2013Updated 12 years ago
- A book detailing how to build command line applications in Rust☆13Mar 25, 2018Updated 8 years ago
- ActivityStreams 2.0 encoding/decoding for Go 1.18+☆13Aug 31, 2025Updated 6 months ago
- ☆11Sep 8, 2016Updated 9 years ago