scrapedia / scrapy-useragents
A downloader middleware to change user-agent of scrapy
☆21Updated 5 years ago
Alternatives and similar repositories for scrapy-useragents:
Users that are interested in scrapy-useragents are comparing it to the libraries listed below
- A collection of pipelines for Scrapy☆16Updated 2 weeks ago
- Library to populate items using XPath and CSS with a convenient API☆48Updated 3 weeks ago
- Simple caching transport for httpx☆51Updated last year
- One interface to read and write the data in various excel formats, import the data into and export the data from databases☆59Updated 3 weeks ago
- OpenAPI represented as a Python type. Use it to parse specifications written in JSON and YAML formats.☆11Updated 2 years ago
- A lightweight package that provides rate-limited httpx transports.☆29Updated 2 weeks ago
- Common interface for data container classes☆67Updated 3 weeks ago
- Sans-I/O implementation of SOCKS4, SOCKS4A, and SOCKS5☆53Updated last year
- Mimesis integration with factory_boy☆52Updated last year
- sqlalchemy dialect for rqlite, the lightweight, distributed database built on SQLite.☆44Updated 10 months ago
- Mimesis integration with the pytest test runner. This plugin provider useful fixtures based on providers from Mimesis.☆62Updated last year
- Declarative request parsing and validation for Starlette with webargs☆39Updated 2 years ago
- An admin interface for ASGI Web frameworks.☆135Updated 3 years ago
- MongoEngine Extras - Field Types and any other wizardry.☆49Updated 6 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Updated 3 years ago
- A Pytest plugin that allows you to loop tests for a user defined amount of time.☆42Updated 2 years ago
- Trio-compatible version of click. The issue tracker is at python-trio/trio-click☆15Updated last year
- A query expression for extracting data from JSON.☆41Updated 3 months ago
- Replace Starlette's TestClient from `requests` to `httpx`! 🎉☆42Updated 2 years ago
- A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them☆65Updated 2 years ago
- A middleware of cookies persistence for Scrapy☆28Updated last month
- Parser for Different Python Models (pure Python classes, Pydantic, Enums, ORMs: DjangoORM, Tortoise, SqlAlchemy, GinoORM, PonyORM, Pydal)…☆18Updated last year
- Library for annotation-based dependency injection☆21Updated 2 months ago
- A scrapy middleware to use rotated proxy ip list.☆24Updated 6 years ago
- Sentry component for Scrapy☆86Updated last year
- Lightweight browser hot reload for Python ASGI web apps☆151Updated 11 months ago
- The minimum Litestar application☆17Updated last year
- Caching for HTTPX☆70Updated 8 months ago
- AintQ Is Not Task Queue - a Python asyncio task queue on PostgreSQL.☆50Updated 2 years ago
- This is a project generator to start FastApi project☆44Updated 2 years ago