Alternatives and similar repositories for scrapy

Users that are interested in scrapy are comparing it to the libraries listed below

• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆17,044Updated last year
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,487Updated last year
• tornadoweb / tornado
  Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
  ☆22,440Updated 2 weeks ago
• ansible / ansible
  Ansible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. Automate eve…
  ☆67,887Updated last week
• psf / requests
  A simple, yet elegant, HTTP library.
  ☆53,709Updated last week
• pallets / flask
  The Python micro framework for building web applications.
  ☆71,142Updated this week
• fabric / fabric
  Simple, Pythonic remote execution and deployment.
  ☆15,390Updated 6 months ago
• twisted / twisted
  Event-driven networking engine written in Python.
  ☆5,939Updated 3 weeks ago
• rmax / scrapy-redis
  Redis-based components for Scrapy.
  ☆5,648Updated last year
• django / django
  The Web framework for perfectionists with deadlines.
  ☆86,700Updated this week
• scikit-learn / scikit-learn
  scikit-learn: machine learning in Python
  ☆64,973Updated this week
• moby / moby
  The Moby Project - a collaborative project for the container ecosystem to assemble container-based systems
  ☆71,444Updated last week
• python-pillow / Pillow
  Python Imaging Library (Fork)
  ☆13,372Updated this week
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,087Updated 3 weeks ago
• codelucas / newspaper
  newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
  ☆14,968Updated 2 months ago
• pandas-dev / pandas
  Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects,…
  ☆47,780Updated last week
• google / python-fire
  Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.
  ☆28,096Updated last week
• celery / celery
  Distributed Task Queue (development branch)
  ☆27,977Updated last week
• ariya / phantomjs
  Scriptable Headless Browser
  ☆29,496Updated 3 years ago
• vinta / awesome-python
  An opinionated list of awesome Python frameworks, libraries, software and resources.
  ☆281,797Updated last week
• rq / rq
  Simple job queues for Python
  ☆10,575Updated last week
• pallets / jinja
  A very fast and expressive template engine.
  ☆11,444Updated 7 months ago
• josephmisiti / awesome-machine-learning
  A curated list of awesome Machine Learning frameworks, libraries and software.
  ☆71,580Updated last week
• nltk / nltk
  NLTK Source
  ☆14,493Updated last month
• nicolargo / glances
  Glances an Eye on your system. A top/htop alternative for GNU/Linux, BSD, Mac OS and Windows operating systems.
  ☆31,554Updated last week
• BruceDone / awesome-crawler
  A collection of awesome web crawler,spider in different languages
  ☆7,104Updated last year
• gogs / gogs
  Gogs is a painless self-hosted Git service
  ☆47,533Updated this week
• plotly / dash
  Data Apps & Dashboards for Python. No JavaScript Required.
  ☆24,458Updated this week
• python / cpython
  The Python programming language
  ☆71,344Updated last week
• grafana / grafana
  The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Pro…
  ☆72,035Updated this week