hermit-crab / ScrapeMateLinks
Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
☆122Updated 7 years ago
Alternatives and similar repositories for ScrapeMate
Users that are interested in ScrapeMate are comparing it to the libraries listed below
Sorting:
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆153Updated 2 years ago
- A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆119Updated last year
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- Offline-first web browser☆92Updated 6 years ago
- Comprehensive wrapper and execution manager for the Chrome browser using the Chrome Debugging Protocol.☆228Updated 7 months ago
- Web data extraction tool implemented as chrome extension with much more features☆46Updated 7 years ago
- Creates github index for similar repositories discovery☆192Updated 9 years ago
- Scrapy middleware which allows to crawl only new content☆79Updated last week
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆110Updated last year
- Traditional "Web 2.0" social bookmarking, with small improvements☆101Updated 2 years ago
- A simple Python wrapper for the archive.is capturing service☆209Updated 10 months ago
- Flask code to deploy an API that pulls structured data from online news articles☆231Updated 3 years ago
- Python Implementation of Google PageSpeed Insights☆40Updated last year
- admin ui for scrapy/open source scrapinghub☆58Updated 4 years ago
- Tool for real-time scraping of news articles.☆39Updated 6 years ago
- Dump data from Twitter's public API.☆118Updated 2 years ago
- HyperTag - Intuitive Knowledge Management WebApp & CLI for Humans using Deep Learning & Tags☆196Updated 9 months ago
- A dead simple web-clipper | ✂Capture ⇒ ⊞ Select ⇒ ✔Done☆32Updated 7 years ago
- script that generates an rss feed out of websites that don't have one☆31Updated 6 years ago
- Extract text from HTML☆135Updated 5 years ago
- Save data from Google Takeout to a SQLite database☆117Updated 2 years ago
- The most boring open source you've ever seen ....☆125Updated 2 years ago
- A helper library full of URL-related heuristics.☆73Updated 3 months ago
- Scrapy rotation proxy package with advanced functions☆95Updated 3 years ago
- Cloud crawler functions for scrapeulous☆45Updated 4 years ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆435Updated 3 years ago
- DevTools Extension for Chrome and Firefox - Fast and easy way to copy full HTML widgets, components, and parts of web design.☆109Updated 4 years ago
- An algorithm for generating robust XPath locators for web testing.☆185Updated 2 years ago
- backup and parse your browser history databases (chrome, firefox, safari, and other chrome/firefox derivatives)☆156Updated 3 weeks ago
- Chromium Browser Automation (extension for chrome browser automation).☆126Updated last year