LeMoussel / playwright-webcrawler

Related projects: ⓘ

• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆39Updated 2 years ago
• scrapinghub / shub-workflow
  ☆13Updated this week
• elacuesta / scrapy-pyppeteer
  Pyppeteer integration for Scrapy
  ☆60Updated 3 years ago
• ispras / scrapy-puppeteer
  Library that helps use puppeteer in scrapy.
  ☆51Updated this week
• scrapy / itemadapter
  Common interface for data container classes
  ☆61Updated last month
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆129Updated 4 years ago
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆56Updated 2 weeks ago
• scrapinghub / autoextract-spiders
  Pre-built Scrapy spiders for AutoExtract
  ☆19Updated 4 months ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆55Updated 2 years ago
• dragnet-org / dragnet_data
  code and data used to build a training dataset for dragnet models
  ☆10Updated 3 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆93Updated 2 months ago
• HyperionGray / python-chrome-devtools-protocol
  Python type wrappers for Chrome DevTools Protocol (CDP)
  ☆97Updated 10 months ago
• zytedata / zyte-smartproxy-headless-proxy
  A complimentary proxy to help to use SPM with headless browsers
  ☆108Updated last year
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆42Updated 5 years ago
• Granitosaurus / playwright-stealth
  ☆121Updated 10 months ago
• scrapy-plugins / scrapy-headless
  ☆29Updated 3 years ago
• genomoncology / entitykb
  ☆22Updated this week
• hynky1999 / CmonCrawl
  Common crawl extractor
  ☆67Updated 3 months ago
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 3 years ago
• haralyzer / haralyzer
  A Framework For Using HAR Files To Analyze Web Pages
  ☆139Updated last month
• networkdynamics / seldonite
  A News Article Collection Library
  ☆22Updated last year
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 6 years ago
• NikolaiT / stealthy-scraping-tools
  Minimal set of tools to conduct stealthy scraping.
  ☆144Updated last year
• johnbumgarner / newshound
  This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…
  ☆31Updated last year
• clemfromspace / scrapy-puppeteer
  Scrapy + Puppeteer
  ☆110Updated 3 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• Hironsan / google-natural-language-sampler
  Code examples for Google Natural Language API.
  ☆13Updated 5 years ago
• doccano / spacy-partial-tagger
  A simple library for training named entity recognition model from partially annotated data
  ☆21Updated 10 months ago
• Layout-Parser / annotation-service
  ☆15Updated 3 years ago
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆98Updated 4 years ago