lipoja / URLExtract

Related projects ⓘ

Alternatives and complementary repositories for URLExtract

• barseghyanartur / tld
  Extracts the top level domain (TLD) from the URL given.
  ☆179Updated last year
• niksite / url-normalize
  URL normalization for Python
  ☆94Updated 2 years ago
• scrapinghub / price-parser
  Extract price amount and currency symbol from a raw text string
  ☆316Updated 2 weeks ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆197Updated last month
• bsolomon1124 / demoji
  Accurately find/replace/remove emojis in text strings
  ☆158Updated 11 months ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆131Updated 4 years ago
• jvanasco / metadata_parser
  python library for getting metadata
  ☆141Updated 5 months ago
• scrapinghub / number-parser
  Parse numbers written in natural language
  ☆109Updated 3 weeks ago
• PyYoshi / cChardet
  universal character encoding detector
  ☆388Updated 5 months ago
• requests / requests-threads
  🎭 Twisted Deferred Thread backend for Requests.
  ☆417Updated 5 years ago
• seomoz / reppy
  Modern robots.txt Parser for Python
  ☆189Updated 10 months ago
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆64Updated last month
• wbolster / jsonlines
  python library to simplify working with jsonlines and ndjson data
  ☆274Updated 3 months ago
• NicolasLM / atoma
  Atom, RSS and JSON feed parser for Python 3
  ☆115Updated 2 years ago
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆55Updated this week
• GateNLP / ultimate-sitemap-parser
  Ultimate Website Sitemap Parser
  ☆181Updated last year
• scrapy / itemadapter
  Common interface for data container classes
  ☆62Updated last month
• jawah / charset_normalizer
  Truly universal encoding detector in pure Python
  ☆585Updated this week
• matthiask / html-sanitizer
  Allowlist-based HTML cleaner
  ☆129Updated 5 months ago
• andreasvc / pyre2
  Python wrapper for RE2
  ☆99Updated 2 months ago
• rmax / scrapy-inline-requests
  A decorator to write coroutine-like spider callbacks.
  ☆110Updated last year
• aboSamoor / pycld2
  ☆165Updated 5 months ago
• rspeer / langcodes
  A Python library for working with and comparing language codes.
  ☆339Updated 7 months ago
• kjd / idna
  Internationalized Domain Names for Python (IDNA 2008 and UTS #46)
  ☆249Updated 2 months ago
• facelessuser / soupsieve
  A modern CSS selector implementation for BeautifulSoup
  ☆206Updated last month
• ko-zu / psl
  publicsuffixlist for python
  ☆62Updated this week
• pycountry / pycountry
  A Python library to access ISO country, subdivision, language, currency and script definitions and their translations.
  ☆767Updated last week
• avian2 / unidecode
  ASCII transliterations of Unicode text - GitHub mirror
  ☆531Updated 6 months ago
• yeraydiazdiaz / lunr.py
  A Python implementation of Lunr.js 🌖
  ☆189Updated 2 weeks ago
• further-reading / scrapy-gui
  A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.
  ☆106Updated 6 months ago