hermit-crab / ScrapeMateLinks
Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
☆122Updated 7 years ago
Alternatives and similar repositories for ScrapeMate
Users that are interested in ScrapeMate are comparing it to the libraries listed below
Sorting:
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆153Updated 2 years ago
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 4 years ago
- A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆119Updated last year
- DIY Atom feeds in times of social media and paywalls☆85Updated last year
- Tool for real-time scraping of news articles.☆39Updated 6 years ago
- Scrapy middleware which allows to crawl only new content☆79Updated 3 years ago
- Traditional "Web 2.0" social bookmarking, with small improvements☆101Updated 2 years ago
- 🦛 scrapes websites and generates rss feeds☆54Updated 10 months ago
- The most boring open source you've ever seen ....☆127Updated 2 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- Creates github index for similar repositories discovery☆192Updated 9 years ago
- Flask code to deploy an API that pulls structured data from online news articles☆231Updated 3 years ago
- admin ui for scrapy/open source scrapinghub☆58Updated 4 years ago
- A simple Python wrapper for the archive.is capturing service☆208Updated 10 months ago
- Parses Firefox/Chrome HTML bookmarks files☆48Updated last year
- Scrapy rotation proxy package with advanced functions☆95Updated 3 years ago
- Cloud crawler functions for scrapeulous☆45Updated 4 years ago
- script that generates an rss feed out of websites that don't have one☆31Updated 6 years ago
- A Scrapy middleware to bypass the CloudFlare's anti-bot protection☆112Updated 4 years ago
- Detect and classify pagination links☆104Updated 2 months ago
- Save data from Google Takeout to a SQLite database☆117Updated 2 years ago
- linkbak is a web page archiver : it reads a list of links and dumps the corresponding pages in HTML and PDF.☆13Updated 3 years ago
- Offline-first web browser☆91Updated 6 years ago
- Web data extraction tool implemented as chrome extension with much more features☆46Updated 7 years ago
- Extract text from HTML☆135Updated 5 years ago
- Create high-quality images programmatically with easily-hackable templates.☆190Updated last year
- web scraping extension☆84Updated 4 months ago
- Your body's dashboard.☆94Updated last year
- HyperTag - Intuitive Knowledge Management WebApp & CLI for Humans using Deep Learning & Tags☆196Updated 8 months ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆435Updated 2 years ago