jvanasco / metadata_parserLinks
python library for getting metadata
☆156Updated 3 months ago
Alternatives and similar repositories for metadata_parser
Users that are interested in metadata_parser are comparing it to the libraries listed below
Sorting:
- URLExtract is python class for collecting (extracting) URLs from given text based on locating TLD.☆272Updated last year
- A python module to parse the Open Graph Protocol☆236Updated 3 years ago
- A Python library for extracting titles, images, descriptions and canonical urls from HTML.☆151Updated 5 years ago
- Web scraping Page Objects core library☆104Updated last week
- Simple, robust email validation☆134Updated 3 years ago
- URL normalization for Python☆99Updated 7 months ago
- A Python library for finding feed links on websites.☆53Updated 3 years ago
- Extract text from HTML☆135Updated 5 years ago
- Allowlist-based HTML cleaner☆153Updated 5 months ago
- a small library for extracting rich content from urls☆669Updated last year
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆121Updated last year
- Analyze scraped data☆46Updated 6 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- Extracts OpenGraph, TwitterCard and Schema properties from a webpage.☆83Updated last year
- Scrapy middleware which allows to crawl only new content☆79Updated this week
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆110Updated last year
- Extracts the top level domain (TLD) from the URL given.☆181Updated 6 months ago
- Extract price amount and currency symbol from a raw text string☆345Updated 2 months ago
- A Scrapy extension to log items coverage when the spider shuts down☆19Updated 5 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆55Updated 3 years ago
- A generic crawler☆78Updated 7 years ago
- Twitter text processing library (auto linking and extraction of usernames, lists and hashtags).☆178Updated last year
- Anonymize django database. Big-data anonymizer. Preply team.☆47Updated 5 months ago
- Modern robots.txt Parser for Python☆196Updated last year
- Automatic unit test generation for Scrapy.☆57Updated 4 years ago
- RSS Aggregator☆92Updated 4 years ago
- A client interface for Scrapinghub's API☆205Updated 2 months ago
- A classifier for detecting soft 404 pages☆57Updated this week
- A helper library full of URL-related heuristics.☆73Updated 3 months ago
- A lightweight customisable RSS reader for Django.☆173Updated 2 years ago