scrapy / parsel
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
☆1,216Updated 2 weeks ago
Alternatives and similar repositories for parsel:
Users that are interested in parsel are comparing it to the libraries listed below
- HTTP API for Scrapy spiders☆853Updated 9 months ago
- Scrapy Extension for monitoring spiders execution.☆541Updated this week
- Python library of web-related functions☆402Updated 3 weeks ago
- Run JavaScript code from Python (EOL: https://gist.github.com/doloopwhile/8c6ec7dd4703e8a44e559411cb2ea221)☆716Updated 5 years ago
- A jquery-like library for python☆2,347Updated 7 months ago
- Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).☆1,249Updated last month
- A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html☆862Updated 3 months ago
- Random User-Agent middleware based on fake-useragent☆695Updated last year
- python parser for human readable dates☆2,639Updated 3 weeks ago
- Command line client for Scrapyd server☆772Updated last month
- Standards-compliant library for parsing and serializing HTML documents and fragments in Python☆1,189Updated last year
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆271Updated last month
- Scrapy+Splash for JavaScript integration☆3,197Updated 2 months ago
- 🎭 Playwright integration for Scrapy☆1,149Updated last month
- Convert Javascript code to an XML document☆186Updated 3 years ago
- 🎭 Twisted Deferred Thread backend for Requests.☆417Updated 5 years ago
- A pure-python HTML screen-scraping library☆1,870Updated 3 years ago
- A service daemon to run Scrapy spiders☆3,023Updated this week
- universal character encoding detector☆398Updated 3 months ago
- Parsing JavaScript objects into Python data structures☆204Updated last month
- Retrying is an Apache 2.0 licensed general-purpose retrying library, written in Python, to simplify the task of adding retry behavior to …☆1,922Updated 3 years ago
- Yet another URL library☆1,397Updated last week
- 🌐 URL parsing and manipulation made easy.☆2,676Updated 3 weeks ago
- Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python☆276Updated 2 weeks ago
- Async requests-like httplib for python.☆509Updated 2 years ago
- Web Content Retrieval for Humans™☆620Updated 2 years ago
- A scalable frontier for web crawlers☆1,309Updated 2 months ago
- A toolbelt of useful classes and functions to be used with python-requests☆1,008Updated 3 months ago
- Web Scraping Framework☆2,403Updated last year
- The lxml XML toolkit for Python☆2,805Updated last week