scrapinghub / js2xml

Related projects ⓘ

Alternatives and complementary repositories for js2xml

• scrapy / w3lib
  Python library of web-related functions
  ☆392Updated last month
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆197Updated last month
• scrapy / cssselect
  CSS Selectors for Python
  ☆291Updated last month
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆267Updated 3 years ago
• rmax / scrapy-inline-requests
  A decorator to write coroutine-like spider callbacks.
  ☆110Updated last year
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆98Updated 4 years ago
• scrapy / queuelib
  Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python
  ☆269Updated last month
• seomoz / reppy
  Modern robots.txt Parser for Python
  ☆189Updated 10 months ago
• lopuhin / scrapy-pyppeteer
  Use pyppeteer from a Scrapy spider
  ☆60Updated 4 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• scrapy / parsel
  Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
  ☆1,148Updated last month
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆131Updated 4 years ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated this week
• further-reading / scrapy-gui
  A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.
  ☆106Updated 6 months ago
• scrapinghub / price-parser
  Extract price amount and currency symbol from a raw text string
  ☆316Updated 2 weeks ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆62Updated last month
• scrapinghub / spidermon
  Scrapy Extension for monitoring spiders execution.
  ☆533Updated last week
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆45Updated last month
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆95Updated last month
• llonchj / scrapy-sentry
  Sentry component for Scrapy
  ☆86Updated last year
• requests / requests-threads
  🎭 Twisted Deferred Thread backend for Requests.
  ☆417Updated 5 years ago
• scrapinghub / scrapy-autounit
  Automatic unit test generation for Scrapy.
  ☆55Updated 3 years ago
• TeamHG-Memex / aquarium
  Splash + HAProxy + Docker Compose
  ☆198Updated 5 years ago
• elacuesta / scrapy-pyppeteer
  Pyppeteer integration for Scrapy
  ☆60Updated 3 years ago
• scrapinghub / shub
  Scrapinghub Command Line Client
  ☆125Updated 6 months ago
• chazkii / chromewhip
  Scriptable Google Chrome™ as a HTTP service + asyncio driver
  ☆118Updated last year
• clemfromspace / scrapy-puppeteer
  Scrapy + Puppeteer
  ☆111Updated 3 years ago
• Mimino666 / python-xextract
  Extract structured data from HTML and XML documents like a boss.
  ☆50Updated last year
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 8 years ago
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆187Updated 2 years ago