get-set-fetch / scraperLinks
Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
☆114Updated 2 years ago
Alternatives and similar repositories for scraper
Users that are interested in scraper are comparing it to the libraries listed below
Sorting:
- web scraping extension☆83Updated 3 weeks ago
- House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.☆121Updated 2 years ago
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppetee…☆94Updated 2 years ago
- Base Docker images for Apify actors.☆79Updated this week
- 🧱 A uniform template to use as a foundation for Puppeteer bot construction.☆66Updated 4 years ago
- Phantombuster's SDK☆14Updated 7 months ago
- A simple puppeteer wrapper to enable useful plugins with ease☆56Updated this week
- Utilities and constants shared across Apify projects.☆14Updated this week
- Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other …☆30Updated 3 years ago
- Web scraper using Cloudflare Workers☆24Updated 3 years ago
- NodeJs package for generating browser-like headers.☆72Updated 2 years ago
- Cloud crawler functions for scrapeulous☆45Updated 4 years ago
- An undetectable browser automation framework 🤖☆32Updated 3 years ago
- Generate a list of keywords from any text.☆31Updated 5 years ago
- Automated functional testing via the Chrome DevTools Protocol. Easy to use and open source. Generates unique CSS and Xpath selectors. Out…☆56Updated 4 years ago
- Generates realistic browser fingerprints☆78Updated 2 years ago
- A single tab web browser built with puppeteer. Also, no client-side JS. Viewport is streamed with MJPEG. For realz.☆56Updated last year
- Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt☆82Updated last year
- ☆115Updated last year
- Home of the Ulixee Open Data Platform☆52Updated last week
- Web data extraction tool implemented as chrome extension with much more features☆47Updated 6 years ago
- A case management app built with Lowdefy.☆32Updated last year
- This GitHub project is a scraper specifically designed to extract all Facebook ads from the Facebook Ads Library. The scraper is capable …☆24Updated last year
- Send emails from Google Sheets☆70Updated 4 years ago
- A puppeteer-extra plugin to remotely view and interact with puppeteer sessions. Essentially opening a "portal" to the page.☆53Updated 2 years ago
- Standalone puppeteer playground in browser's developer tools.☆227Updated last year
- Wish your facebook friends from command line, never miss the wish! http://npm.im/facebook-birthday-cli☆58Updated 5 years ago
- Scrapes WordPress data using the WP-JSON API activated by default since WordPress 4.7☆101Updated last year
- Chromium / Puppeteer site crawler☆49Updated 5 years ago
- The ultimate tool for obtaining free proxies from multiple sources and storing them in a MongoDB database.☆21Updated 2 years ago