Alternatives and similar repositories for awesome-scrapy

Users that are interested in awesome-scrapy are comparing it to the libraries listed below

• AccordBox / awesome-scrapy

  View on GitHub
  A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
  ☆556Dec 28, 2022Updated 3 years ago
• ejulio / spider-feeder

  View on GitHub
  A library to make it easier to load input URLs to start scrapy processes
  ☆14Feb 21, 2021Updated 4 years ago
• scrapy / itemloaders

  View on GitHub
  Library to populate items using XPath and CSS with a convenient API
  ☆47Jan 29, 2026Updated 2 weeks ago
• zytedata / zyte-autoextract

  View on GitHub
  Python clients for Zyte AutoExtract API
  ☆41Jan 17, 2022Updated 4 years ago
• toxtli / daw

  View on GitHub
  GridSound wants to be a free browser-based HTML5 DAW (Digital Audio Workstation) following the new Web Audio API. You can test the applic…
  ☆12Dec 9, 2018Updated 7 years ago
• apify / actor-scrapy-executor

  View on GitHub
  Apify actor to run web spiders written in Python in the Scrapy library
  ☆12Dec 11, 2022Updated 3 years ago
• python-ruia / awesome-ruia

  View on GitHub
  A list of awesome project for Ruia
  ☆13Aug 24, 2022Updated 3 years ago
• realslimshanky / Spider-Sense

  View on GitHub
  A browser extension to monitor your spiders deployed on Scrapy Cloud.
  ☆16Mar 8, 2025Updated 11 months ago
• fabiotabalipa / cnes-hospitais

  View on GitHub
  Rotina em python para obtenção de dados dos hospitais brasileiros via Cadastro Nacional de Estabelecimentos de Saúde (CNES)
  ☆17Jan 3, 2024Updated 2 years ago
• Nykakin / chompjs

  View on GitHub
  Parsing JavaScript objects into Python data structures
  ☆217Aug 4, 2025Updated 6 months ago
• scrapinghub / scrapy-poet

  View on GitHub
  Page Object pattern for Scrapy
  ☆126Jan 28, 2026Updated 2 weeks ago
• freaker2k7 / translingual

  View on GitHub
  Multilingual transliteration - phonetic translation using transcription.
  ☆26Aug 4, 2019Updated 6 years ago
• thombashi / humanreadable

  View on GitHub
  humanreadable is a Python library to convert human-readable values to other units.
  ☆21Oct 27, 2025Updated 3 months ago
• TeamHG-Memex / html-text

  View on GitHub
  Extract text from HTML
  ☆134Updated this week
• scrapinghub / andi

  View on GitHub
  Library for annotation-based dependency injection
  ☆24Dec 9, 2025Updated 2 months ago
• scrapy-plugins / scrapy-jsonschema

  View on GitHub
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆45Mar 26, 2021Updated 4 years ago
• scrapinghub / scrapinghub-entrypoint-scrapy

  View on GitHub
  Scrapy entrypoint for Scrapinghub job runner
  ☆26Jan 28, 2026Updated 2 weeks ago
• scrapinghub / scrapy-autounit

  View on GitHub
  Automatic unit test generation for Scrapy.
  ☆57Jul 12, 2021Updated 4 years ago
• DotNetAge / scrapy_plus

  View on GitHub
  scrapy 常用爬网必备工具包
  ☆25Feb 8, 2023Updated 3 years ago
• scrapinghub / scrapy-autoextract

  View on GitHub
  Zyte Automatic Extraction integration for Scrapy
  ☆56Feb 4, 2022Updated 4 years ago
• hudson-and-thames / a-practitioners-guide-to-the-ONC-algorithm

  View on GitHub
  Code base for the practitioner's guide to the ONC algorithm paper published with the Journal of Financial Data Science
  ☆20Jun 8, 2023Updated 2 years ago
• mikenieva / learning-guitar-shop

  View on GitHub
  Proyecto de comercio electrónico. Tienda Online de Guitarras.
  ☆10Apr 13, 2019Updated 6 years ago
• scrapy / itemadapter

  View on GitHub
  Common interface for data container classes
  ☆68Jan 8, 2026Updated last month
• pavloo / dag-traverse-celery-example

  View on GitHub
  ☆29Mar 8, 2018Updated 7 years ago
• scrapinghub / scrapy-frontera

  View on GitHub
  More flexible and featured Frontera scheduler for Scrapy
  ☆36Jun 6, 2025Updated 8 months ago
• 1rocketdude / pyetrade_option_chains

  View on GitHub
  exemplar code to download all option chains for a symbol using pyetrade (V1 Etrade API)
  ☆10Sep 28, 2021Updated 4 years ago
• le1nux / datastack

  View on GitHub
  a stream-based file storage solution for machine learning datasets.
  ☆11May 26, 2022Updated 3 years ago
• shyam1998 / Movie-Recommendation-System-GUI

  View on GitHub
  movie-recommendation-system-GUI
  ☆10Aug 15, 2020Updated 5 years ago
• csaluja / Data-Science-Projects-in-Python

  View on GitHub
  Data-Science-Projects-in-Python
  ☆11Jul 25, 2018Updated 7 years ago
• taoufik07 / django-graphene-permissions

  View on GitHub
  DGP - A DRF like permission system for django graphene
  ☆30Dec 8, 2022Updated 3 years ago
• scrapinghub / price-parser

  View on GitHub
  Extract price amount and currency symbol from a raw text string
  ☆347Updated this week
• FortechRomania / xamarin-continuous-integration

  View on GitHub
  Xamarin Continuous Integration with Unit Tests & Acceptance (UI) Tests
  ☆12Dec 18, 2017Updated 8 years ago
• VarunPatelius / Crime-Watch

  View on GitHub
  An application that takes your current location, address, or latitude/longitude and returns a map showing crimes that have occurred near …
  ☆10Dec 6, 2020Updated 5 years ago
• best-doctor / pre-commit-hooks

  View on GitHub
  General purpose pre-commit hooks used by BestDoctor for Python projects.
  ☆12Jan 18, 2022Updated 4 years ago
• SHAKOTN / awesome-web3

  View on GitHub
  List of awesome web3 resources
  ☆12Oct 12, 2021Updated 4 years ago
• nschlaepfer / humanWeb

  View on GitHub
  This is a Python project that uses Selenium and OpenAI to scrape data from the web, process it with GPT-3, and generate reports based on …
  ☆12Oct 28, 2025Updated 3 months ago
• tinybirdco / use-case-examples

  View on GitHub
  Use cases examples using Versions
  ☆11May 12, 2025Updated 9 months ago
• TetrodoPotato / Pr0jectWatch

  View on GitHub
  ☆12Jul 9, 2020Updated 5 years ago
• my8100 / logparser

  View on GitHub
  A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
  ☆93Jan 5, 2025Updated last year