michaelhelmick / lassie
Web Content Retrieval for Humans™
☆620Updated 2 years ago
Alternatives and similar repositories for lassie
Users that are interested in lassie are comparing it to the libraries listed below
Sorting:
- a small library for extracting rich content from urls☆650Updated 5 months ago
- A pure-python HTML screen-scraping library☆1,874Updated 3 years ago
- Python library of web-related functions☆406Updated last week
- An Extensible Image Crawler☆159Updated 8 years ago
- HTTP API for Scrapy spiders☆857Updated 10 months ago
- A Python 3 library for parsing human-written times and dates☆345Updated 5 years ago
- A simple, immutable URL class with a clean API for interrogation and manipulation.☆294Updated last year
- A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html☆864Updated 4 months ago
- "Scrape Easy" - an extension of the Scrapy framework.☆188Updated 8 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Updated 3 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆273Updated 2 months ago
- PyQuery-based scraping micro-framework.☆116Updated 3 years ago
- MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…☆357Updated 4 years ago
- A client interface for Scrapinghub's API☆206Updated 2 months ago
- Convert Javascript code to an XML document☆186Updated 3 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆109Updated 11 months ago
- Scrapy extension to control spiders using JSON-RPC☆300Updated 5 years ago
- A Python library for extracting titles, images, descriptions and canonical urls from HTML.☆150Updated 4 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆190Updated 3 years ago
- Wrapping web APIs made easy.☆1,242Updated 4 years ago
- An object-oriented approach to Python file/directory operations.☆511Updated 3 years ago
- Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors☆1,224Updated this week
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆90Updated 3 years ago
- Python powered spreadsheets☆172Updated 6 years ago
- Reworked https://www.readability.com/ parsing library (now https://mercury.postlight.com/ is living alternative)☆204Updated last year
- CSS Selectors for Python☆297Updated last week
- Bringing sanity to world of messed-up data☆66Updated 10 years ago
- Python flexible slugify function☆487Updated 5 years ago
- Extract text from HTML☆135Updated 4 years ago
- A scalable frontier for web crawlers☆1,310Updated 3 months ago