Alternatives and similar repositories for python-scrapfly:

Users that are interested in python-scrapfly are comparing it to the libraries listed below

• ispras / scrapy-puppeteer
  Library that helps use puppeteer in scrapy.
  ☆52Updated last week
• scrapy / itemadapter
  Common interface for data container classes
  ☆67Updated last month
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆96Updated last month
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆135Updated 2 months ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆120Updated last month
• testdrivenio / concurrent-web-scraping
  Building a Concurrent Web Scraper with Python and Selenium
  ☆34Updated 3 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• peopledatalabs / peopledatalabs-python
  A Python client for the People Data Labs API
  ☆30Updated this week
• x-tabdeveloping / neofuzz
  Blazing fast fuzzy text search for Python.
  ☆42Updated last month
• johnbumgarner / newspaper3_usage_overview
  This repository provides usage examples for the Python module Newspaper3k.
  ☆146Updated last year
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆28Updated this week
• spider-rs / spider-py
  Spider ported to Python
  ☆68Updated last month
• TheWebScrapingClub / TheScrapingClubFree
  The Web Scraping Club Free Repository
  ☆137Updated 4 months ago
• repollo / llm_data_parser
  This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.
  ☆29Updated last year
• johnbumgarner / newshound
  This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…
  ☆33Updated 2 years ago
• ScrapingBee / scrapingbee-python
  A Python library to interact with ScrapingBee's API for headless browsers and proxy rotation
  ☆26Updated 6 months ago
• zytedata / zyte-spider-templates-project
  ☆19Updated 3 weeks ago
• ZenRows / scaling-to-distributed-crawling
  Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.
  ☆42Updated 3 years ago
• Blacksuan19 / scrapy-ai
  Fully automated AI based web scraping.
  ☆15Updated last month
• VianneyMI / monggregate
  Library to make MongoDB aggregation framework and pipelines easy to use in python.
  ☆21Updated 9 months ago
• eventbrite / pymetrics
  Versatile Metrics Collection for Python
  ☆18Updated last year
• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆38Updated last week
• PrefectHQ / prefect-openai
  Prefect integrations for working with OpenAI.
  ☆36Updated 10 months ago
• databyjp / distyll
  A personal knowledge base that I can dump information to and help me learn
  ☆24Updated 9 months ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• the-real-tokai / grablinks
  A simple and streamlined Python script to extract and filter links from a remote HTML resource.
  ☆24Updated 2 months ago
• hynky1999 / CmonCrawl
  Common crawl extractor
  ☆75Updated 9 months ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆202Updated this week
• jrieke / fastapi-csv
  🏗️ Create APIs from CSV files within seconds, using fastapi
  ☆76Updated 3 years ago
• Asugawara / requests-html-playwright
  Requests-HTML(with microsoft/playwright-python): HTML Parsing for Humans™
  ☆31Updated last month