BetaStreetOmnis / WebExtractoLinks

通用爬虫工具,内嵌了google、bing和duckduckgo的搜索引擎,并可以用过requests、selenium或者palywright来爬取页面信息,并能遍历官网所有有效网页,并利用大模型实现整个网站的内容解析及分析,可以用户自动化获取网站信息,提升信息收集效率。
22Updated 2 months ago

Alternatives and similar repositories for WebExtracto

Users that are interested in WebExtracto are comparing it to the libraries listed below

Sorting: