Alternatives and similar repositories for python-scrapfly

Users that are interested in python-scrapfly are comparing it to the libraries listed below

• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆32Updated last month
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆102Updated 3 weeks ago
• ispras / scrapy-puppeteer
  Library that helps use puppeteer in scrapy.
  ☆52Updated 3 months ago
• spider-rs / spider-py
  Spider ported to Python
  ☆97Updated 9 months ago
• zytedata / zyte-spider-templates-project
  ☆20Updated 7 months ago
• theonlyanil / stealthkit
  Python requests on steroids.
  ☆167Updated 6 months ago
• peopledatalabs / peopledatalabs-python
  A Python client for the People Data Labs API
  ☆36Updated last week
• ScrapingAnt / scrapingant-client-python
  ScrapingAnt API client for Python.
  ☆43Updated last year
• airtai / faststream-gen
  The faststream-gen library uses advanced AI to generate FastStream code from user descriptions, speeding up FastStream app development.
  ☆48Updated last year
• scrapy / itemadapter
  Common interface for data container classes
  ☆68Updated last week
• testdrivenio / concurrent-web-scraping
  Building a Concurrent Web Scraper with Python and Selenium
  ☆33Updated 3 years ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆214Updated 3 months ago
• johnbalvin / pybnb
  Airbnb scraper made in Python
  ☆51Updated last year
• runprism / prism
  Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.
  ☆86Updated 11 months ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆123Updated last month
• repollo / llm_data_parser
  This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.
  ☆30Updated 2 years ago
• iwpnd / fastapi-key-auth
  FastAPI API key authorizer
  ☆42Updated last week
• weeping-angel / medium-api
  Python Wrapper on top of Unofficial Medium API to quickly extract data from Medium's website.
  ☆58Updated 4 months ago
• Blacksuan19 / scrapy-ai
  Fully automated AI based web scraping.
  ☆32Updated 9 months ago
• ScrapingBee / scrapingbee-python
  A Python library to interact with ScrapingBee's API for headless browsers and proxy rotation
  ☆29Updated last month
• christo-olivier / modelsmith
  Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …
  ☆78Updated 2 months ago
• johnbumgarner / newspaper3_usage_overview
  This repository provides usage examples for the Python module Newspaper3k.
  ☆148Updated last year
• jrieke / fastapi-csv
  🏗️ Create APIs from CSV files within seconds, using fastapi
  ☆79Updated 4 years ago
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆73Updated last month
• mkrd / Flask-Squeeze
  Automatically minify JS/CSS and compress all responses with brotli, defalte or gzip, with caching for static assets
  ☆16Updated 4 months ago
• inngest / inngest-py
  Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere
  ☆148Updated last week
• AlexWiles / pai
  pai: A Python REPL with a built in AI agent
  ☆41Updated 2 years ago
• sushil-rgb / AmazonMe
  Introducing AmazonMe, a Python-based web scraper designed to extract data from amazon.com using the requests and beautifulSoup libraries.…
  ☆66Updated last year
• michaelherold / pyIsEmail
  Simple, robust email validation
  ☆134Updated 3 years ago
• nottheswimmer / dalle
  Explore the DALL·E 2 API in Python
  ☆55Updated 2 years ago