Alternatives and similar repositories for python-scrapfly

Users that are interested in python-scrapfly are comparing it to the libraries listed below

• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆104Updated this week
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆34Updated 3 weeks ago
• zytedata / zyte-spider-templates-project
  ☆20Updated 2 weeks ago
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆158Updated last month
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆217Updated 5 months ago
• ispras / scrapy-puppeteer
  Library that helps use puppeteer in scrapy.
  ☆52Updated 6 months ago
• spider-rs / spider-py
  Spider ported to Python
  ☆103Updated last week
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆125Updated this week
• Asugawara / requests-html-playwright
  Requests-HTML(with microsoft/playwright-python): HTML Parsing for Humans™
  ☆34Updated last year
• scrapy / itemadapter
  Common interface for data container classes
  ☆68Updated 3 weeks ago
• Blacksuan19 / scrapy-ai
  Fully automated AI based web scraping.
  ☆33Updated 2 weeks ago
• christo-olivier / modelsmith
  Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …
  ☆81Updated 4 months ago
• theonlyanil / stealthkit
  Python requests on steroids.
  ☆170Updated 8 months ago
• johnbumgarner / newspaper3_usage_overview
  This repository provides usage examples for the Python module Newspaper3k.
  ☆151Updated 2 years ago
• peopledatalabs / peopledatalabs-python
  A Python client for the People Data Labs API
  ☆35Updated last week
• ScrapingBee / scrapingbee-python
  A Python library to interact with ScrapingBee's API for headless browsers and proxy rotation
  ☆29Updated last week
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆41Updated 4 years ago
• apify / apify-client-python
  Apify API client for Python
  ☆88Updated this week
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆105Updated last week
• zytedata / python-zyte-api
  Python client for Zyte API
  ☆28Updated 3 months ago
• weeping-angel / medium-api
  Python Wrapper on top of Unofficial Medium API to quickly extract data from Medium's website.
  ☆61Updated 6 months ago
• bitmakerla / estela
  estela, an elastic web scraping cluster 🕸
  ☆194Updated last week
• Hannes221 / rq-dashboard-fast
  Redis Queue Dashboard based on FastAPI
  ☆122Updated last month
• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆39Updated last week
• weblyzard / inscriptis
  A python based HTML to text conversion library, command line client and Web service.
  ☆333Updated 2 months ago
• airtai / faststream-gen
  The faststream-gen library uses advanced AI to generate FastStream code from user descriptions, speeding up FastStream app development.
  ☆48Updated last year
• AlexWiles / pai
  pai: A Python REPL with a built in AI agent
  ☆41Updated 2 years ago
• MichaelTatarski / fake-http-header
  A python package to generate random request fields for a http header.
  ☆45Updated 6 months ago
• amenezes / aiopytesseract
  A Python asyncio wrapper for Tesseract-OCR.
  ☆27Updated 2 weeks ago
• michaelherold / pyIsEmail
  Simple, robust email validation
  ☆133Updated 3 years ago