Alternatives and similar repositories for autoscraper

Users that are interested in autoscraper are comparing it to the libraries listed below

• lorey / mlscraper
  🤖 Scrape data from HTML websites automatically by just providing examples
  ☆1,363Updated last year
• h2oai / wave
  Realtime Web Apps and Dashboards for Python and R
  ☆4,147Updated this week
• pyppeteer / pyppeteer
  Headless chrome/chromium automation library (unofficial port of puppeteer)
  ☆3,890Updated last year
• scrapy-plugins / scrapy-playwright
  🎭 Playwright integration for Scrapy
  ☆1,243Updated last week
• microsoft / playwright-python
  Python version of the Playwright testing and automation library.
  ☆13,538Updated this week
• jbesomi / texthero
  Text preprocessing, representation and visualization from zero to hero.
  ☆2,905Updated last year
• lux-org / lux
  Automatically visualize your pandas dataframe via a single print! 📊 💡
  ☆5,295Updated last year
• MechanicalSoup / MechanicalSoup
  A Python library for automating interaction with websites.
  ☆4,781Updated this week
• claffin / cloudproxy
  Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
  ☆1,480Updated last week
• kotartemiy / pygooglenews
  If Google News had a Python library
  ☆1,362Updated 8 months ago
• kotartemiy / newscatcher
  Programmatically collect normalized news from (almost) any website.
  ☆2,967Updated 4 years ago
• clemfromspace / scrapy-selenium
  Scrapy middleware to handle javascript pages using selenium
  ☆949Updated last year
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,166Updated last year
• adbar / trafilatura
  Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XM…
  ☆4,573Updated this week
• mherrmann / helium
  Lighter web automation with Python
  ☆7,977Updated 3 months ago
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,218Updated 6 months ago
• AndyTheFactory / newspaper4k
  📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
  ☆839Updated 5 months ago
• bee-san / pyWhat
  🐸 Identify anything. pyWhat easily lets you identify emails, IP addresses, and more. Feed it a .pcap file or some text and it'll tell …
  ☆6,962Updated last year
• Iceloof / GoogleNews
  Script for GoogleNews
  ☆375Updated last year
• gnebbia / kb
  A minimalist command line knowledge base manager
  ☆3,260Updated last month
• twintproject / twint
  An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, fo…
  ☆16,187Updated 2 years ago
• JustAnotherArchivist / snscrape
  A social networking service scraper in Python
  ☆5,032Updated last year
• ml-tooling / best-of-web-python
  🏆 A ranked list of awesome python libraries for web development. Updated weekly.
  ☆2,569Updated last week
• NikolaiT / se-scraper
  Javascript scraping module based on puppeteer for many different search engines...
  ☆563Updated 2 years ago
• unsplash / datasets
  🎁 6,500,000+ Unsplash images made available for research and machine learning
  ☆2,587Updated 3 months ago
• my8100 / scrapydweb
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,321Updated 5 months ago
• connorferster / handcalcs
  Python library for converting Python calculations into rendered latex.
  ☆5,774Updated last month
• apify / crawlee-python
  Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…
  ☆6,149Updated this week
• ml-tooling / opyrator
  🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.
  ☆3,132Updated last week
• maxhumber / gazpacho
  🥫 The simple, fast, and modern web scraping library
  ☆769Updated last year