hermit-crab / ScrapeMateLinks
Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
☆104Updated 7 years ago
Alternatives and similar repositories for ScrapeMate
Users that are interested in ScrapeMate are comparing it to the libraries listed below
Sorting:
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆151Updated 2 years ago
- A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆116Updated last year
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 4 years ago
- Flask code to deploy an API that pulls structured data from online news articles☆229Updated 2 years ago
- Create high-quality images programmatically with easily-hackable templates.☆188Updated 10 months ago
- Tool for real-time scraping of news articles.☆39Updated 5 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- Traditional "Web 2.0" social bookmarking, with small improvements☆100Updated 2 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆109Updated last year
- Parses Firefox/Chrome HTML bookmarks files☆49Updated last year
- Creates github index for similar repositories discovery☆193Updated 9 years ago
- A helper library full of URL-related heuristics.☆70Updated last month
- The most boring open source you've ever seen ....☆128Updated last year
- Parse government documents into well formed JSON☆70Updated 3 weeks ago
- Google/Excel Sheets API Python.☆70Updated 10 months ago
- script that generates an rss feed out of websites that don't have one☆31Updated 6 years ago
- 🦛 scrapes websites and generates rss feeds☆53Updated 5 months ago
- Save data from Google Takeout to a SQLite database☆109Updated last year
- Offline-first web browser☆89Updated 6 years ago
- A python library detect and extract listing data from HTML page.☆108Updated 8 years ago
- Build a search index across content from multiple SQLite database tables and run faceted searches against it using Datasette☆195Updated 3 years ago
- Ultimate Website Sitemap Parser☆222Updated 3 weeks ago
- Tag news stories based on models trained on the NYT corpus.☆42Updated 2 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆51Updated 7 years ago
- A dead simple web-clipper | ✂Capture ⇒ ⊞ Select ⇒ ✔Done☆32Updated 7 years ago
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆90Updated 3 years ago
- Add website scraping abilities to Datasette☆64Updated 2 years ago
- 🐍 A Hackernews clone in flask + python + sqlalchemy☆36Updated 2 years ago
- A complimentary proxy to help to use SPM with headless browsers☆108Updated 2 years ago
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago