hermit-crab / ScrapeMateLinks
Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
☆105Updated 7 years ago
Alternatives and similar repositories for ScrapeMate
Users that are interested in ScrapeMate are comparing it to the libraries listed below
Sorting:
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆153Updated 2 years ago
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 4 years ago
- A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆118Updated last year
- Scrapy middleware which allows to crawl only new content☆79Updated 2 years ago
- Tool for real-time scraping of news articles.☆39Updated 6 years ago
- DIY Atom feeds in times of social media and paywalls☆85Updated last year
- Flask code to deploy an API that pulls structured data from online news articles☆230Updated 2 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆189Updated 3 years ago
- Parses Firefox/Chrome HTML bookmarks files☆49Updated last year
- Web data extraction tool implemented as chrome extension with much more features☆46Updated 6 years ago
- A simple Python wrapper for the archive.is capturing service☆204Updated 8 months ago
- Creates github index for similar repositories discovery☆192Updated 9 years ago
- script that generates an rss feed out of websites that don't have one☆31Updated 6 years ago
- Extract text from HTML☆134Updated 5 years ago
- python api wrapper for https://mercury.postlight.com/web-parser/☆25Updated 2 years ago
- Comprehensive wrapper and execution manager for the Chrome browser using the Chrome Debugging Protocol.☆227Updated 4 months ago
- 🦛 scrapes websites and generates rss feeds☆54Updated 8 months ago
- Create high-quality images programmatically with easily-hackable templates.☆188Updated last year
- A helper library full of URL-related heuristics.☆71Updated 2 weeks ago
- admin ui for scrapy/open source scrapinghub☆58Updated 4 years ago
- A dead simple web-clipper | ✂Capture ⇒ ⊞ Select ⇒ ✔Done☆32Updated 7 years ago
- Scrapy rotation proxy package with advanced functions☆95Updated 3 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆110Updated last year
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- Strip non-presentational content out of HTML pages☆45Updated 3 years ago
- DevTools Extension for Chrome and Firefox - Fast and easy way to copy full HTML widgets, components, and parts of web design.☆106Updated 4 years ago
- A Reddit bot that summarizes news articles written in Spanish or English. It uses a custom built algorithm to rank words and sentences.☆277Updated 3 years ago
- HyperTag - Intuitive Knowledge Management WebApp & CLI for Humans using Deep Learning & Tags☆196Updated 6 months ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆432Updated 2 years ago
- Cloud crawler functions for scrapeulous☆45Updated 4 years ago