scrapinghub / extruct

Related projects ⓘ

Alternatives and complementary repositories for extruct

• scrapinghub / scrapyrt
  HTTP API for Scrapy spiders
  ☆835Updated 4 months ago
• scrapinghub / spidermon
  Scrapy Extension for monitoring spiders execution.
  ☆533Updated last week
• scrapinghub / price-parser
  Extract price amount and currency symbol from a raw text string
  ☆316Updated 2 weeks ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆257Updated 6 months ago
• TeamHG-Memex / scrapy-rotating-proxies
  use multiple proxies with Scrapy
  ☆739Updated 2 years ago
• scrapinghub / frontera
  A scalable frontier for web crawlers
  ☆1,302Updated last year
• scrapy / parsel
  Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
  ☆1,148Updated last month
• scrapy / scrapely
  A pure-python HTML screen-scraping library
  ☆1,863Updated 2 years ago
• scrapy / w3lib
  Python library of web-related functions
  ☆392Updated last month
• scrapinghub / js2xml
  Convert Javascript code to an XML document
  ☆186Updated 2 years ago
• derek73 / python-nameparser
  A simple Python module for parsing human names into their individual components
  ☆658Updated 5 months ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆197Updated last month
• scrapinghub / dateparser
  python parser for human readable dates
  ☆2,560Updated last week
• michaelhelmick / lassie
  Web Content Retrieval for Humans™
  ☆614Updated 2 years ago
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆187Updated 2 years ago
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆267Updated 3 years ago
• dragnet-org / dragnet
  Just the facts -- web page content extraction
  ☆1,254Updated 4 months ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆729Updated 6 months ago
• GateNLP / ultimate-sitemap-parser
  Ultimate Website Sitemap Parser
  ☆181Updated last year
• scaleway / postal-address
  Parse, normalize and render postal addresses.
  ☆182Updated last year
• seomoz / reppy
  Modern robots.txt Parser for Python
  ☆189Updated 10 months ago
• alecxe / scrapy-fake-useragent
  Random User-Agent middleware based on fake-useragent
  ☆687Updated last year
• misja / python-boilerpipe
  Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages
  ☆539Updated 3 years ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆131Updated 4 years ago
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆831Updated 3 months ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆289Updated 6 months ago
• rushter / selectolax
  Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
  ☆1,161Updated last week
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated this week
• datamade / probablepeople
  a python library for parsing unstructured western names into name components.
  ☆593Updated 3 weeks ago
• kootenpv / sky
  next generation web crawling using machine intelligence
  ☆329Updated last year