Javascript scraping module based on puppeteer for many different search engines...
☆568Dec 30, 2022Updated 3 years ago
Alternatives and similar repositories for se-scraper
Users that are interested in se-scraper are comparing it to the libraries listed below
Sorting:
- A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.☆2,796Jul 3, 2021Updated 4 years ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆438Dec 30, 2022Updated 3 years ago
- Minimal set of tools to conduct stealthy scraping.☆163Apr 21, 2023Updated 2 years ago
- Search google, bing, yahoo, and other search engines with python☆670Apr 2, 2025Updated 11 months ago
- Puppeteer Pool, run a cluster of instances in parallel☆3,513Updated this week
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆272Oct 26, 2025Updated 4 months ago
- Nodejs lib to parse Google SERP html pages☆46Jul 27, 2023Updated 2 years ago
- Google search scraper with captcha solving support☆90Oct 23, 2019Updated 6 years ago
- LinkRun - Data Engineering project done in 3 weeks during the Insight fellowship☆39Apr 2, 2020Updated 5 years ago
- Distributed crawler powered by Headless Chrome☆5,710Apr 29, 2023Updated 2 years ago
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.☆662Jun 5, 2021Updated 4 years ago
- Kimono is a tool that allows data to be extracted from Websites quickly and easily. It is extremely useful when you need to generate a CS…☆13Mar 16, 2017Updated 8 years ago
- Google search from Python (unofficial).☆1,247Nov 11, 2025Updated 3 months ago
- Fetch Google/Bing search results using PHP☆103Jan 28, 2026Updated last month
- A collection of awesome web crawler,spider in different languages☆7,130Jun 16, 2024Updated last year
- Google Search Scraper☆568Aug 23, 2019Updated 6 years ago
- advertools - online marketing productivity and analysis tools☆1,354Sep 23, 2025Updated 5 months ago
- 🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos…☆3,090Jun 7, 2025Updated 8 months ago
- Scrapoxy has been discontinued.☆2,432Feb 7, 2026Updated 3 weeks ago
- Visual scraping for Scrapy☆9,493Jun 26, 2024Updated last year
- An SEO tool that analyzes the structure of a site, crawls the site, count words in the body of the site and warns of any technical SEO is…☆1,405Jan 8, 2026Updated last month
- Scrape all the pages and links of a given domain and write the results to Google Cloud BigQuery.☆39Sep 7, 2020Updated 5 years ago
- Simple NLP Article Spinner algorithm☆12Aug 30, 2018Updated 7 years ago
- Scrapy + Puppeteer☆110Jun 11, 2021Updated 4 years ago
- Adaptive crawler which uses Reinforcement Learning methods☆168Feb 10, 2026Updated 3 weeks ago
- A scalable frontier for web crawlers☆1,330Jun 6, 2025Updated 9 months ago
- Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS☆4,117Mar 18, 2024Updated last year
- Additional module to use with 'puppeteer' for setting proxies per page basis.☆450Jun 9, 2024Updated last year
- Scrape google search results☆94Aug 24, 2018Updated 7 years ago
- A Smart, Automatic, Fast and Lightweight Web Scraper for Python☆7,106Jun 9, 2025Updated 8 months ago
- The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos el…☆195Feb 21, 2025Updated last year
- Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data …☆22,013Updated this week
- A Scrapy script to spider a website and scrape all emails using a regex.☆12Dec 21, 2016Updated 9 years ago
- A pure-python HTML screen-scraping library☆1,886Apr 4, 2022Updated 3 years ago
- EcommerceTools is a Python data science toolkit for ecommerce, marketing science, and technical SEO analysis and modelling and was create…☆260Jan 29, 2024Updated 2 years ago
- newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:☆14,997Dec 6, 2025Updated 3 months ago
- Scrapy Extension for monitoring spiders execution.☆551Updated this week
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆57Jan 28, 2024Updated 2 years ago
- Scrapy middleware which allows to crawl only new content☆79Feb 10, 2026Updated 3 weeks ago