seomoz / url-pyLinks
URL Transformation, Sanitization
☆103Updated last year
Alternatives and similar repositories for url-py
Users that are interested in url-py are comparing it to the libraries listed below
Sorting:
- A scrapy extension to store requests and responses information in storage service☆26Updated 3 years ago
- feedparser but faster and worse☆104Updated 3 years ago
- Faster replacement for Python's urlparse module☆46Updated 6 years ago
- A Python library for finding feed links on websites.☆52Updated 2 years ago
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆20Updated 8 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- asyncio compatible driver for elasticsearch☆97Updated 6 years ago
- URL normalization for Python☆95Updated last month
- Configurable method retrying for Pythonistas.☆69Updated 2 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- Python 3 AsyncIO powered scraping framework with batteries included☆20Updated 8 years ago
- CSS Selectors for Python☆297Updated 3 weeks ago
- A set of useful tools for aiohttp.web server☆79Updated this week
- Crochet: use Twisted anywhere!☆237Updated 9 months ago
- A backend for ZODB that stores pickles in a relational database.☆55Updated 3 months ago
- Modern robots.txt Parser for Python☆194Updated last year
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Updated 3 years ago
- Parsing and validation of URIs (RFC 3896) and IRIs (RFC 3987)☆46Updated last year
- Asynchronous generators, context managers and other utilities for use with asyncio☆63Updated 7 years ago
- Simple HTTP cache for Python Requests☆97Updated 8 years ago
- Finds flaws in your python code☆39Updated 7 years ago
- A module for querying the DOM tree and writing XPath expressions using native Python syntax.☆127Updated 6 years ago
- Python TTL Dictionary - dictionary with key expiry time☆22Updated 6 years ago
- A painless assertion and validation library for Python.☆66Updated 2 years ago
- Paginating the web☆37Updated 11 years ago
- ☆53Updated 9 years ago
- PyOpenGraph is a library written in Python for parsing Open Graph protocol information from web sites.☆94Updated 11 years ago
- Sentry component for Scrapy☆86Updated last year
- python bindings for rlite☆70Updated 7 years ago
- Django-admin command to display migrations with dependencies.☆48Updated 2 years ago