get-set-fetch / scraper
Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
☆110Updated last year
Alternatives and similar repositories for scraper:
Users that are interested in scraper are comparing it to the libraries listed below
- All In One API to easily scrape data from any website, without worrying about captchas and bot detection mecanisms.☆21Updated last year
- web scraping extension☆80Updated 5 months ago
- 🧱 A uniform template to use as a foundation for Puppeteer bot construction.☆65Updated 3 years ago
- A single tab web browser built with puppeteer. Also, no client-side JS. Viewport is streamed with MJPEG. For realz.☆56Updated last year
- A simple puppeteer wrapper to enable useful plugins with ease☆55Updated this week
- Base Docker images for Apify actors.☆75Updated this week
- Cloud crawler functions for scrapeulous☆45Updated 4 years ago
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆69Updated 3 years ago
- An undetectable browser automation framework 🤖☆31Updated 3 years ago
- House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.☆120Updated last year
- Object storage microservice. Like minio but minnier.☆9Updated 5 years ago
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppetee…☆94Updated 2 years ago
- Generates realistic browser fingerprints☆72Updated 2 years ago
- Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt☆80Updated 11 months ago
- Utilities and constants shared across Apify projects.☆13Updated this week
- An alternative to sticking that lovely web app into an <iframe> on a corp website☆51Updated 3 years ago
- Web crawling & scraping framework for Node.js on top of headless Chrome browser☆19Updated last year
- A free, open source tool to lookup user identities by email address☆35Updated 8 months ago
- Minimal set of tools to conduct stealthy scraping.☆154Updated last year
- NodeJs package for generating browser-like headers.☆67Updated 2 years ago
- Home of fingerprint injector.☆67Updated 2 years ago
- Email automation driven by headless chrome.☆163Updated 4 years ago
- Instagram automation driven by headless chrome.☆117Updated 2 years ago
- The ultimate tool for obtaining free proxies from multiple sources and storing them in a MongoDB database.☆22Updated last year
- Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other …☆29Updated 3 years ago
- Web data extraction tool implemented as chrome extension with much more features☆46Updated 6 years ago
- 🕺 Humanizer functions for Puppeteer☆36Updated last year
- Phantombuster's SDK☆14Updated 4 months ago
- A browser extension that lets you find email addresses for any domain with a single click.☆71Updated 7 years ago
- A case management app built with Lowdefy.☆32Updated last year