Web grep: search all rendered resources used by a URI
☆89Nov 21, 2025Updated 4 months ago
Alternatives and similar repositories for wgrep
Users that are interested in wgrep are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A scrapy extension to sync `.scrapy` folder to an S3 bucket☆18Mar 28, 2022Updated 4 years ago
- A crawler demo to illustrate web crawling.☆28Nov 3, 2020Updated 5 years ago
- Scrapy middleware to handle javascript pages using selenium☆20Jul 3, 2021Updated 4 years ago
- 🎭 Playwright integration for Scrapy☆1,384Jan 21, 2026Updated 2 months ago
- The most advanced debugging and testing tool for Scrapy☆16Apr 19, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Library to populate items using XPath and CSS with a convenient API☆48Jan 29, 2026Updated 2 months ago
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- A pure-Python robots.txt parser with support for modern conventions.☆85Jan 29, 2026Updated 2 months ago
- A Gerrit CLI☆20Mar 24, 2026Updated 2 weeks ago
- A scrapy spider for R18☆16Mar 30, 2026Updated last week
- A downloader middleware to change user-agent of scrapy☆21Jun 1, 2019Updated 6 years ago
- ☆13Aug 25, 2024Updated last year
- Parsing JavaScript objects into Python data structures☆218Aug 4, 2025Updated 8 months ago
- A collection of FastHTML demos I'm putting together as part of my learning process. I hope it helps you too!☆11Nov 1, 2024Updated last year
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- A library to make it easier to load input URLs to start scrapy processes☆14Feb 21, 2021Updated 5 years ago
- A simple example of how to implement DDD under a hexagonal architecture.☆12Mar 25, 2021Updated 5 years ago
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Mar 8, 2025Updated last year
- A collection of pipelines for Scrapy☆16Mar 30, 2026Updated last week
- Source real estate prices from the Common Crawl.☆27Oct 22, 2018Updated 7 years ago
- Scrapy+Splash for JavaScript integration☆3,232Feb 11, 2025Updated last year
- Demo/Template for FastHTML with TailwindCSS for styling, without CDN☆20Nov 9, 2024Updated last year
- Grepify the GUI Regex Text Scanner for Code Reviewers☆23Apr 15, 2013Updated 12 years ago
- In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framewor…☆12Feb 2, 2020Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A project to attempt to automatically login to a website given a single seed☆11Jun 17, 2024Updated last year
- Scrapy middleware to handle javascript pages using selenium☆958Jul 8, 2024Updated last year
- Track torrent-trackers☆20Oct 3, 2012Updated 13 years ago
- XLSX exporter for Scrapy☆28Dec 11, 2022Updated 3 years ago
- Didactic Web crawler for Web Search Engines (CS 6913) course at NYU☆10Dec 8, 2022Updated 3 years ago
- A minimalist microblogging platform 🐦🔇☆10Apr 4, 2026Updated last week
- Time series forecasting with DuckDB and Evidence☆43Nov 1, 2024Updated last year
- Material do artigo: Como Criar um Sistema de Recomendação de Produtos Usando Machine Learning☆11Feb 1, 2017Updated 9 years ago
- A scrapy extension to store requests and responses information in storage service☆27Mar 11, 2022Updated 4 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Extract price amount and currency symbol from a raw text string☆345Mar 19, 2026Updated 3 weeks ago
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 6 years ago
- Lab for exercising SPARQL☆12Jan 16, 2022Updated 4 years ago
- Access SOAP web services from GNU Emacs. This package is maintained as part of the GNU Emacs source repository☆10Jun 17, 2018Updated 7 years ago
- Python library of web-related functions☆418Mar 20, 2026Updated 3 weeks ago
- python parser for human readable dates☆2,797Mar 31, 2026Updated last week
- Scrapy project template. Use it to quickly spin up a new web scraping project☆16Nov 18, 2024Updated last year