Web grep: search all rendered resources used by a URI
☆89Nov 21, 2025Updated 6 months ago
Alternatives and similar repositories for wgrep
Users that are interested in wgrep are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆57Mar 16, 2022Updated 4 years ago
- Analyze scraped data☆46Dec 9, 2019Updated 6 years ago
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Jan 16, 2024Updated 2 years ago
- 🎭 Playwright integration for Scrapy☆1,403Apr 9, 2026Updated last month
- Library to populate items using XPath and CSS with a convenient API☆48Jan 29, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- A pure-Python robots.txt parser with support for modern conventions.☆87Jan 29, 2026Updated 3 months ago
- This repo builds a Docker image whose container instances can be used as a development environment for Evidence projects via a mounted di…☆16Dec 13, 2024Updated last year
- A declarative data-migration package☆16Dec 7, 2024Updated last year
- ☆13Aug 25, 2024Updated last year
- Scrapy Extension for monitoring spiders execution.☆558Apr 26, 2026Updated 3 weeks ago
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆21Feb 8, 2017Updated 9 years ago
- A library to make it easier to load input URLs to start scrapy processes☆14Feb 21, 2021Updated 5 years ago
- Parsing JavaScript objects into Python data structures☆218Aug 4, 2025Updated 9 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A simple example of how to implement DDD under a hexagonal architecture.☆12Mar 25, 2021Updated 5 years ago
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Mar 8, 2025Updated last year
- tools☆20May 13, 2025Updated last year
- Scrapinghub Command Line Client☆130Apr 28, 2026Updated 3 weeks ago
- traversal functionality for the Shift AST format☆21Feb 16, 2019Updated 7 years ago
- A cookiecutter template for a Sphinx extension☆28Jan 11, 2024Updated 2 years ago
- CSI driver to bootstrap COSI workloads☆18May 7, 2023Updated 3 years ago
- Useful codes for ACM-ICPC contests☆12Nov 19, 2020Updated 5 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Demo/Template for FastHTML with TailwindCSS for styling, without CDN☆20Nov 9, 2024Updated last year
- Common interface for data container classes☆69May 6, 2026Updated 2 weeks ago
- In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framewor…☆12Feb 2, 2020Updated 6 years ago
- Zyte Automatic Extraction integration for Scrapy☆57Apr 13, 2026Updated last month
- A library and command line tool utility to organise your media ( Photos and videos ) better☆16Nov 15, 2018Updated 7 years ago
- VLC remote control interface for emacs☆12Sep 12, 2019Updated 6 years ago
- Scrapy middleware to handle javascript pages using selenium☆952Apr 13, 2026Updated last month
- Didactic Web crawler for Web Search Engines (CS 6913) course at NYU☆10Dec 8, 2022Updated 3 years ago
- Progzee is a Python library for simplifying IP proxy usage in HTTP requests.☆16Feb 28, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Pluggable DSL that uses pipes to perform a series of linear transformations to extract data☆16Jul 9, 2024Updated last year
- JWT Auth toolkit for Starlite☆12Nov 29, 2022Updated 3 years ago
- ☆10Jan 24, 2021Updated 5 years ago
- Material do artigo: Como Criar um Sistema de Recomendação de Produtos Usando Machine Learning☆11Feb 1, 2017Updated 9 years ago
- Archiving tool for Google Photos☆16May 15, 2026Updated last week
- Extract price amount and currency symbol from a raw text string☆345Mar 19, 2026Updated 2 months ago
- Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management☆17Sep 2, 2017Updated 8 years ago