hermit-crab / ScrapeMateLinks
Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
☆103Updated 7 years ago
Alternatives and similar repositories for ScrapeMate
Users that are interested in ScrapeMate are comparing it to the libraries listed below
Sorting:
- A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆115Updated last year
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆150Updated 2 years ago
- script that generates an rss feed out of websites that don't have one☆30Updated 6 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- A simple Python wrapper for the archive.is capturing service☆201Updated 3 months ago
- Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head☆170Updated 5 years ago
- Tool for real-time scraping of news articles.☆39Updated 5 years ago
- Traditional "Web 2.0" social bookmarking, with small improvements☆100Updated 2 years ago
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 3 years ago
- A helper library full of URL-related heuristics.☆69Updated 2 months ago
- admin ui for scrapy/open source scrapinghub☆58Updated 4 years ago
- Add website scraping abilities to Datasette☆62Updated 2 years ago
- Scrapy rotation proxy package with advanced functions☆95Updated 2 years ago
- Scrapy middleware which allows to crawl only new content☆79Updated 2 years ago
- DIY Atom feeds in times of social media and paywalls☆84Updated last year
- Save data from Google Takeout to a SQLite database☆109Updated last year
- Build a search index across content from multiple SQLite database tables and run faceted searches against it using Datasette☆193Updated 3 years ago
- Offline-first web browser☆89Updated 6 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆109Updated last year
- Google/Excel Sheets API Python.☆70Updated 9 months ago
- An algorithm for generating robust XPath locators for web testing.☆185Updated 2 years ago
- Save an RSS or ATOM feed to a SQLite database☆52Updated 2 years ago
- ☆78Updated 3 years ago
- Generate a list of your GitHub stars by topic - automatically!☆77Updated 2 years ago
- Parse government documents into well formed JSON☆70Updated this week
- Web data extraction tool implemented as chrome extension with much more features☆47Updated 6 years ago
- Parses Firefox/Chrome HTML bookmarks files☆49Updated last year
- Web Extension: Easily find Hacker News discussions about the page you're currently browsing.☆269Updated 3 months ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 5 years ago
- Create a SQLite database containing data from your Pocket account☆105Updated last year