Alternatives and similar repositories for python-scrapfly

Users that are interested in python-scrapfly are comparing it to the libraries listed below

• ispras / scrapy-puppeteer
  Library that helps use puppeteer in scrapy.
  ☆52Updated 4 months ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆104Updated last week
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆32Updated last week
• spider-rs / spider-py
  Spider ported to Python
  ☆99Updated 10 months ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆125Updated 2 months ago
• ZenRows / scaling-to-distributed-crawling
  Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.
  ☆46Updated 4 years ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆217Updated 4 months ago
• apify / apify-client-python
  Apify API client for Python
  ☆88Updated this week
• christo-olivier / modelsmith
  Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …
  ☆80Updated 3 months ago
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆154Updated last month
• theonlyanil / stealthkit
  Python requests on steroids.
  ☆168Updated 7 months ago
• zytedata / zyte-spider-templates-project
  ☆20Updated 8 months ago
• pydantic / logfire-demo
  ☆77Updated last week
• stav / wgrep
  Web grep: search all rendered resources used by a URI
  ☆89Updated last month
• scrapy / itemadapter
  Common interface for data container classes
  ☆68Updated this week
• teticio / lambda-scraper
  Use AWS Lambda functions as a proxy pool to scrape web pages.
  ☆139Updated last year
• repollo / llm_data_parser
  This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.
  ☆30Updated 2 years ago
• ScrapingAnt / scrapingant-client-python
  ScrapingAnt API client for Python.
  ☆43Updated last year
• Blacksuan19 / scrapy-ai
  Fully automated AI based web scraping.
  ☆32Updated 10 months ago
• ScrapeOps / scrapeops-scrapy-sdk
  Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the…
  ☆39Updated last year
• weeping-angel / medium-api
  Python Wrapper on top of Unofficial Medium API to quickly extract data from Medium's website.
  ☆58Updated 5 months ago
• inngest / inngest-py
  Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere
  ☆159Updated 2 weeks ago
• bitmakerla / estela
  estela, an elastic web scraping cluster 🕸
  ☆193Updated 2 weeks ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆41Updated 3 years ago
• public-law / open-gov-crawlers
  Parse government documents into well formed JSON
  ☆75Updated this week
• runprism / prism
  Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.
  ☆86Updated last year
• ultrafunkamsterdam / toraio
  toraio - a pool of proxies, shifting on each request [not maintained, please use https://github.com/ultrafunkamsterdam/aionion]
  ☆44Updated 2 years ago
• airtai / faststream-gen
  The faststream-gen library uses advanced AI to generate FastStream code from user descriptions, speeding up FastStream app development.
  ☆48Updated last year
• AlexWiles / pai
  pai: A Python REPL with a built in AI agent
  ☆41Updated 2 years ago
• serpapi / lego-ai-parser
  Lego AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.
  ☆236Updated last year