scrapedia / scrapy-useragents

Related projects: ⓘ

• scrapedia / scrapy-pipelines
  A collection of pipelines for Scrapy
  ☆16Updated last month
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆44Updated 3 months ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆61Updated last month
• obendidi / httpx-cache
  Simple caching transport for httpx
  ☆50Updated 11 months ago
• scrapedia / scrapy-cookies
  A middleware of cookies persistence for Scrapy
  ☆26Updated last month
• scrapinghub / arche
  Analyze scraped data
  ☆47Updated 4 years ago
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 3 years ago
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆54Updated 3 months ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆93Updated 2 months ago
• jesuslosada / scrapy-xlsx
  XLSX exporter for Scrapy
  ☆26Updated last year
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• lewoudar / scalpel
  A fast and powerful web scraping library
  ☆40Updated 2 months ago
• boardpack / reforms
  Reforms is a fresh pydantic-based forms validation and rendering library for Python 3.6+.
  ☆24Updated 7 months ago
• pytest-dev / pytest-mimesis
  Mimesis integration with the pytest test runner. This plugin provider useful fixtures based on providers from Mimesis.
  ☆62Updated 7 months ago
• Alir3z4 / python-currencies
  Display money format and its filthy currencies, for all money lovers out there.
  ☆72Updated 3 years ago
• lk-geimfari / mimesis-factory
  Mimesis integration with factory_boy
  ☆51Updated 6 months ago
• aio-libs / aiohttp-remotes
  A set of useful tools for aiohttp.web server
  ☆80Updated last month
• jschnurr / scrapyscript
  Run a Scrapy spider programmatically from a script or a Celery task - no project required.
  ☆121Updated 3 months ago
• johtso / httpx-caching
  Caching for HTTPX
  ☆64Updated last month
• scrapinghub / andi
  Library for annotation-based dependency injection
  ☆20Updated 3 months ago
• aio-libs / aiologstash
  asyncio logging handler for logstash
  ☆58Updated last year
• stummjr / flake8-scrapy
  A Flake8 plugin to catch common issues on Scrapy spiders
  ☆19Updated 2 years ago
• sethmlarson / socksio
  Sans-I/O implementation of SOCKS4, SOCKS4A, and SOCKS5
  ☆51Updated 6 months ago
• scrapehero / selectorlib
  A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them
  ☆66Updated last year
• xnuinside / py-models-parser
  Parser for Different Python Models (pure Python classes, Pydantic, Enums, ORMs: DjangoORM, Tortoise, SqlAlchemy, GinoORM, PonyORM, Pydal)…
  ☆19Updated last year
• encode / sentry-asgi
  Sentry integration for ASGI frameworks.
  ☆73Updated 4 years ago
• romis2012 / httpx-socks
  Proxy (HTTP, SOCKS) transports for httpx
  ☆77Updated 4 months ago
• yunstanford / sanic-transmute
  Easily document your Sanic API with Swagger UI, Plus param validation and model serialization.
  ☆48Updated 2 years ago
• realslimshanky / Spider-Sense
  A browser extension to monitor your spiders deployed on Scrapy Cloud.
  ☆15Updated 3 years ago
• lexiq-legal / pydantic_schemaorg
  Schema.org classes in pydantic
  ☆57Updated last year