🕶 Awesome list of Scrapy tools and libraries
☆61Jul 6, 2020Updated 5 years ago
Alternatives and similar repositories for awesome-scrapy
Users that are interested in awesome-scrapy are comparing it to the libraries listed below
Sorting:
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆558Dec 28, 2022Updated 3 years ago
- A library to make it easier to load input URLs to start scrapy processes☆14Feb 21, 2021Updated 5 years ago
- Library to populate items using XPath and CSS with a convenient API☆47Jan 29, 2026Updated last month
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- GridSound wants to be a free browser-based HTML5 DAW (Digital Audio Workstation) following the new Web Audio API. You can test the applic…☆12Dec 9, 2018Updated 7 years ago
- Apify actor to run web spiders written in Python in the Scrapy library☆12Dec 11, 2022Updated 3 years ago
- A list of awesome project for Ruia☆13Aug 24, 2022Updated 3 years ago
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Mar 8, 2025Updated last year
- Web scraping Page Objects core library☆104Jan 27, 2026Updated last month
- Rotina em python para obtenção de dados dos hospitais brasileiros via Cadastro Nacional de Estabelecimentos de Saúde (CNES)☆17Jan 3, 2024Updated 2 years ago
- Parsing JavaScript objects into Python data structures☆217Aug 4, 2025Updated 7 months ago
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 5 years ago
- Page Object pattern for Scrapy☆127Jan 28, 2026Updated last month
- Library for annotation-based dependency injection☆24Mar 3, 2026Updated last week
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 4 years ago
- Scrapy entrypoint for Scrapinghub job runner☆26Feb 26, 2026Updated last week
- scrapy 常用爬网必备工具包☆25Feb 8, 2023Updated 3 years ago
- Zyte Automatic Extraction integration for Scrapy☆56Feb 4, 2022Updated 4 years ago
- Code base for the practitioner's guide to the ONC algorithm paper published with the Journal of Financial Data Science☆20Jun 8, 2023Updated 2 years ago
- Docker para IRPF (programa da Receita Federal para declaração de imposto de renda).☆30Mar 8, 2021Updated 5 years ago
- Common interface for data container classes☆68Feb 23, 2026Updated 2 weeks ago
- ☆29Mar 8, 2018Updated 8 years ago
- A basic AIX enumeration guide for penetration testers/red teamers☆32Apr 11, 2017Updated 8 years ago
- More flexible and featured Frontera scheduler for Scrapy☆36Jun 6, 2025Updated 9 months ago
- Classes to count pulses, debounce digital inputs, and calculate moving averages of analog inputs for a micropython board.☆35Apr 20, 2015Updated 10 years ago
- Data-Science-Projects-in-Python☆11Jul 25, 2018Updated 7 years ago
- Extract price amount and currency symbol from a raw text string☆347Feb 12, 2026Updated 3 weeks ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,405Feb 19, 2025Updated last year
- This is a Python project that uses Selenium and OpenAI to scrape data from the web, process it with GPT-3, and generate reports based on …☆12Oct 28, 2025Updated 4 months ago
- Curated list of yield farms and tools 🤑☆12Jul 15, 2021Updated 4 years ago
- Xamarin Continuous Integration with Unit Tests & Acceptance (UI) Tests☆12Dec 18, 2017Updated 8 years ago
- An application that takes your current location, address, or latitude/longitude and returns a map showing crimes that have occurred near …☆10Dec 6, 2020Updated 5 years ago
- In this repo I show how to simple create an API for your machine learning models in Python☆12Nov 28, 2018Updated 7 years ago
- iOS 17.2 Jailbreak and Jailbreak guides and Download links☆10Nov 1, 2023Updated 2 years ago
- This REST API gateway allow you to send and receive SMS from gammu supported devices☆14Feb 20, 2026Updated 2 weeks ago
- General purpose pre-commit hooks used by BestDoctor for Python projects.☆12Jan 18, 2022Updated 4 years ago
- A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.☆93Jan 5, 2025Updated last year
- List of awesome web3 resources☆12Oct 12, 2021Updated 4 years ago
- Unofficial API for Dontpad.☆10Dec 18, 2018Updated 7 years ago