teticio / lambda-scraper
Use AWS Lambda functions as a proxy pool to scrape web pages.
☆131Updated last year
Alternatives and similar repositories for lambda-scraper
Users that are interested in lambda-scraper are comparing it to the libraries listed below
Sorting:
- Staff fetcher library for LinkedIn - obtain experiences, schools, skills & contact info☆144Updated last month
- estela, an elastic web scraping cluster 🕸☆180Updated 2 months ago
- Get structured JSON data from any page.☆175Updated last year
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆276Updated last year
- The Web Scraping Club Free Repository☆141Updated 2 weeks ago
- ☆23Updated 5 months ago
- Minimal set of tools to conduct stealthy scraping.☆156Updated 2 years ago
- Patching CDP (Chrome DevTools Protocol) leaks on OS level. Easy to use with Playwright, Selenium, and other web automation tools.☆116Updated 8 months ago
- The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler☆115Updated 5 months ago
- Asynchronous alternative to the requests-ip-rotator library☆40Updated 4 months ago
- G2 Scraper helps you collect G2 product data, including names, product descriptions, reviews, ratings, comparisons, alternatives, and mor…☆43Updated 4 months ago
- Super Fast, Super Anti-Detect, and Super Intuitive Web Driver☆65Updated last month
- A drop-in replacement for playwright-python patched with rebrowser-patches. It allows to pass modern automation detection tests.☆65Updated this week
- A python package for finding e-mails, checking deliverability and more.☆64Updated last year
- Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…☆112Updated 2 years ago
- A library to extract the main content from html. Developed for information on LLM and for feeding data into LangChain and LlamaIndex.☆39Updated 11 months ago
- Nodriver integration for Scrapy☆16Updated 4 months ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆430Updated 2 years ago
- Free IP Proxy rotator library for python☆236Updated last month
- playwright stealth☆675Updated 9 months ago
- Zillow scraper made in Python☆59Updated 5 months ago
- A simple LinkedIn profile scraper implemented as a chrome extension☆80Updated last year
- TypeScript library for Google search scraping using http requests with proxy support, pagination, and regional customization. Built for w…☆35Updated 3 months ago
- Create on demand free HTTPS/SOCKS5 proxy servers using AWS Free Tier EC2 instances automatically with Terraform☆92Updated 2 years ago
- Cloud crawler functions for scrapeulous☆45Updated 4 years ago
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppetee…☆94Updated 2 years ago
- 🎭 Intelligent browser header & fingerprint generator☆538Updated last month
- Python SEO keywords suggestion tool. Google Autocomplete, People Also Ask and Related Searches.☆120Updated 2 years ago
- 🧱 A uniform template to use as a foundation for Puppeteer bot construction.☆66Updated 4 years ago
- ☆131Updated last year