hermit-crab / ScrapeMateLinks
Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
☆105Updated 7 years ago
Alternatives and similar repositories for ScrapeMate
Users that are interested in ScrapeMate are comparing it to the libraries listed below
Sorting:
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆151Updated 2 years ago
- A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆116Updated last year
- A simple Python wrapper for the archive.is capturing service☆203Updated 6 months ago
- Flask code to deploy an API that pulls structured data from online news articles☆229Updated 2 years ago
- Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head☆171Updated 5 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆190Updated 3 years ago
- Comprehensive wrapper and execution manager for the Chrome browser using the Chrome Debugging Protocol.☆227Updated 3 months ago
- Offline-first web browser☆89Updated 6 years ago
- A helper library full of URL-related heuristics.☆70Updated 2 months ago
- The most boring open source you've ever seen ....☆127Updated last year
- Tool for real-time scraping of news articles.☆39Updated 5 years ago
- DIY Atom feeds in times of social media and paywalls☆85Updated last year
- Create high-quality images programmatically with easily-hackable templates.☆188Updated 11 months ago
- Extract text from HTML☆134Updated 5 years ago
- script that generates an rss feed out of websites that don't have one☆31Updated 6 years ago
- Traditional "Web 2.0" social bookmarking, with small improvements☆101Updated 2 years ago
- Parses Firefox/Chrome HTML bookmarks files☆50Updated last year
- Scrapy rotation proxy package with advanced functions☆95Updated 3 years ago
- Scrapy middleware which allows to crawl only new content☆79Updated 2 years ago
- Parse government documents into well formed JSON☆72Updated 3 weeks ago
- Intelligent Bookmarking☆264Updated 2 years ago
- A python library detect and extract listing data from HTML page.☆108Updated 8 years ago
- midas is a framework that enables you to enrich your CSV, JSON or Excel dataset with any web API you can think of.☆53Updated 7 years ago
- Web data extraction tool implemented as chrome extension with much more features☆47Updated 6 years ago
- A dead simple web-clipper | ✂Capture ⇒ ⊞ Select ⇒ ✔Done☆32Updated 7 years ago
- A simple Python wrapper and command-line interface for archive.org’s "Save Page Now" capturing service☆182Updated 10 months ago
- HyperTag - Intuitive Knowledge Management WebApp & CLI for Humans using Deep Learning & Tags☆196Updated 5 months ago
- Save data from Google Takeout to a SQLite database☆112Updated last year
- Chrome extension to "Create WARC files from any webpage"☆223Updated last year
- admin ui for scrapy/open source scrapinghub☆58Updated 4 years ago