scrapedia / scrapy-useragentsLinks
A downloader middleware to change user-agent of scrapy
☆21Updated 6 years ago
Alternatives and similar repositories for scrapy-useragents
Users that are interested in scrapy-useragents are comparing it to the libraries listed below
Sorting:
- Simple caching transport for httpx☆53Updated last year
- Library to populate items using XPath and CSS with a convenient API☆47Updated 2 weeks ago
- sqlalchemy dialect for rqlite, the lightweight, distributed database built on SQLite.☆45Updated 2 weeks ago
- Common interface for data container classes☆68Updated this week
- A lightweight package that provides rate-limited httpx transports.☆33Updated 3 months ago
- An admin interface for ASGI Web frameworks.☆133Updated 3 years ago
- Various Django utility functions☆14Updated last month
- MongoEngine Extras - Field Types and any other wizardry.☆49Updated 6 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Updated 3 years ago
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.☆122Updated last year
- Example projects built using Piccolo.☆22Updated 5 months ago
- high-level file-system operations for lazy devs.☆221Updated last week
- Pool for asyncio with multiprocessing, threading and gevent -like interface☆120Updated last year
- Proxy (HTTP, SOCKS) transports for httpx☆85Updated 2 months ago
- Library for annotation-based dependency injection☆23Updated 2 months ago
- dev tools for Sanic☆14Updated 5 years ago
- Caching for HTTPX☆72Updated last year
- Sans-I/O implementation of SOCKS4, SOCKS4A, and SOCKS5☆54Updated last year
- Generate Python model classes (pydantic, attrs, dataclasses) based on JSON datasets with typing module support☆178Updated 5 months ago
- Web scraping Page Objects core library☆101Updated last month
- Easy configurable workers based on asyncio☆45Updated this week
- Pluggable DSL that uses pipes to perform a series of linear transformations to extract data☆16Updated last year
- Python promises☆127Updated last month
- Declarative request parsing and validation for Starlette with webargs☆39Updated 2 years ago
- Use Git and coverage data to run only needed tests☆21Updated 6 months ago
- Integration of psycopg2 with coroutine libraries☆107Updated last year
- Mock server plugin for pytest☆27Updated 3 years ago
- Lightweight browser hot reload for Python ASGI web apps☆157Updated last year
- Flask-Sitemap is a Flask extension helping with sitemap generation.☆54Updated last year
- a version of pythons unittest.Mock with async methods☆27Updated last year