Alternatives and similar repositories for scrapy

Users that are interested in scrapy are comparing it to the libraries listed below

• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,704Updated last year
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,429Updated last year
• pypa / pipenv
  Python Development Workflow for Humans.
  ☆25,078Updated this week
• pallets / flask
  The Python micro framework for building web applications.
  ☆69,919Updated last month
• psf / requests
  A simple, yet elegant, HTTP library.
  ☆53,015Updated 3 weeks ago
• django / django
  The Web framework for perfectionists with deadlines.
  ☆84,168Updated last week
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,161Updated 11 months ago
• faif / python-patterns
  A collection of design patterns/idioms in Python
  ☆41,638Updated 2 months ago
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,214Updated 5 months ago
• pandas-dev / pandas
  Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects,…
  ☆45,889Updated this week
• rq / rq
  Simple job queues for Python
  ☆10,251Updated 3 weeks ago
• celery / celery
  Distributed Task Queue (development branch)
  ☆26,775Updated this week
• gohugoio / hugo
  The world’s fastest framework for building websites.
  ☆82,155Updated this week
• tesseract-ocr / tesseract
  Tesseract Open Source OCR Engine (main repository)
  ☆68,025Updated this week
• kivy / kivy
  Open source UI framework written in Python, running on Windows, Linux, macOS, Android and iOS
  ☆18,468Updated last week
• psf / requests-html
  Pythonic HTML Parsing for Humans™
  ☆13,825Updated last year
• matplotlib / matplotlib
  matplotlib: plotting with Python
  ☆21,423Updated this week
• ansible / ansible
  Ansible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. Automate eve…
  ☆65,546Updated last week
• scikit-learn / scikit-learn
  scikit-learn: machine learning in Python
  ☆62,629Updated this week
• mkdocs / mkdocs
  Project documentation with Markdown.
  ☆20,732Updated 4 months ago
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,043Updated this week
• joke2k / faker
  Faker is a Python package that generates fake data for you.
  ☆18,537Updated last month
• explosion / spaCy
  💫 Industrial-strength Natural Language Processing (NLP) in Python
  ☆31,935Updated last month
• tornadoweb / tornado
  Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
  ☆22,038Updated last week
• Kong / kong
  🦍 The Cloud-Native API Gateway and AI Gateway.
  ☆41,229Updated last week
• puppeteer / puppeteer
  JavaScript API for Chrome and Firefox
  ☆91,138Updated this week
• microsoft / playwright-python
  Python version of the Playwright testing and automation library.
  ☆13,335Updated this week
• clips / pattern
  Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
  ☆8,823Updated last year
• pytorch / pytorch
  Tensors and Dynamic neural networks in Python with strong GPU acceleration
  ☆91,472Updated this week
• pallets / click
  Python composable command line interface toolkit
  ☆16,616Updated last week