lipoja / URLExtract
URLExtract is python class for collecting (extracting) URLs from given text based on locating TLD.
☆253Updated 11 months ago
Alternatives and similar repositories for URLExtract:
Users that are interested in URLExtract are comparing it to the libraries listed below
- Extract text from HTML☆133Updated 4 years ago
- Extracts the top level domain (TLD) from the URL given.☆181Updated last year
- universal character encoding detector☆396Updated 2 months ago
- Modern robots.txt Parser for Python☆190Updated last year
- A pure-Python robots.txt parser with support for modern conventions.☆58Updated 2 weeks ago
- URL normalization for Python☆94Updated 2 years ago
- Extract price amount and currency symbol from a raw text string☆322Updated last week
- A modern CSS selector implementation for BeautifulSoup☆229Updated this week
- Common interface for data container classes☆66Updated last week
- Generator of User-Agent header☆338Updated 7 months ago
- Library to populate items using XPath and CSS with a convenient API☆46Updated 2 weeks ago
- Page Object pattern for Scrapy☆118Updated last week
- python library for getting metadata☆143Updated 3 weeks ago
- Parsing JavaScript objects into Python data structures☆202Updated last month
- Web scraping Page Objects core library☆96Updated last week
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Updated 2 years ago
- A Python library to access ISO country, subdivision, language, currency and script definitions and their translations.☆812Updated this week
- CSS Selectors for Python☆293Updated 2 weeks ago
- Atom, RSS and JSON feed parser for Python 3☆116Updated 2 years ago
- ASCII transliterations of Unicode text - GitHub mirror☆543Updated 9 months ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Updated 3 years ago
- The httplib2 caching algorithms packaged up for use with requests.☆482Updated last week
- A client interface for Scrapinghub's API☆205Updated 2 weeks ago
- 🔗 Immutable, Pythonic, correct URLs.☆285Updated 2 years ago
- ☆168Updated 8 months ago
- A decorator to write coroutine-like spider callbacks.☆110Updated 2 years ago
- publicsuffixlist for python☆66Updated this week
- Detect and classify pagination links☆101Updated 4 years ago
- Parse numbers written in natural language☆109Updated 3 months ago
- A helper library full of URL-related heuristics.☆64Updated 4 months ago