Alternatives and similar repositories for Hawk-Projects

Users that are interested in Hawk-Projects are comparing it to the libraries listed below

• ferventdesert / etlpy
  a smart stream-like crawler & etl python library
  ☆418Updated 5 years ago
• ClericPy / EC-Spider
  Obsolete 已废弃.
  ☆86Updated 8 years ago
• stanzhai / ScrapingSpider
  业余时间开发的，支持多线程，支持关键字过滤，支持正文内容智能识别的爬虫。
  ☆78Updated 12 years ago
• TsingJyujing / tsingspider
  A spider library of several data sources.
  ☆83Updated 2 years ago
• maxliaops / scrapy-itzhaopin
  ☆95Updated 11 years ago
• LiuXingMing / Tmall1212
  天猫双12爬虫，附商品数据。
  ☆199Updated 8 years ago
• shunfa / crawlzilla
  ☆77Updated 2 years ago
• gangtao / dataplay2
  A simple data analysis software
  ☆284Updated 7 years ago
• FullerHua / gooseeker
  ☆697Updated 8 years ago
• Germey / TaobaoMM
  WebSpider of TaobaoMM developed by PySpider
  ☆107Updated 8 years ago
• stanzhai / Html2Article
  Html网页正文提取
  ☆494Updated 3 years ago
• ClericPy / Spider_on_Tianmao_and_Taobao
  已废弃。 Spiders on Tianmao Taobao JingDong。停止更新
  ☆58Updated 8 years ago
• hailong0707-zz / spider_news_all
  Scrapy Spider for 各种新闻网站
  ☆109Updated 9 years ago
• HunterChao / Dangdang
  scrapy爬取当当网图书数据
  ☆73Updated 8 years ago
• 521xueweihan / PySpider
  Python爬虫的学习历程
  ☆52Updated 7 years ago
• Alexis374 / tech_post
  record the technique and thinking when I am coding and learning
  ☆282Updated 8 years ago
• princehaku / pyrailgun
  Simple And Easy Python Crawler Framework，支持抓取javascript渲染的页面的简单实用高效的python网页爬虫抓取模块
  ☆378Updated 3 years ago
• finndychain / finndychain-node
  发源地/发源链开源分布式”数据挖矿“引擎，致力于挖掘大数据矿山背后的价值！
  ☆97Updated 5 years ago
• ZhangBohan / fun_crawler
  Crawl some picture for fun
  ☆162Updated 8 years ago
• omengye / spider
  python Movie Info Web Crawler
  ☆89Updated 8 years ago
• wsguest / geetest
  Crack geetest verify code in C#
  ☆100Updated 4 years ago
• iamyaojie / Spider
  Wandering Spider
  ☆236Updated 8 years ago
• ScarecrowFu / crawllagou
  拉勾网爬虫 lagou spider
  ☆79Updated 3 years ago
• gnemoug / sina_reptile
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆472Updated 12 years ago
• jackgitgz / CnblogsSpider
  用scrapy采集cnblogs列表页爬虫
  ☆275Updated 10 years ago
• littlecodersh / EasierLife
  Coding makes my life easier. This is a factory contains many little programs.
  ☆187Updated 8 years ago
• immzz / zhihu-scrapy
  A scrapy zhihu crawler
  ☆76Updated 6 years ago
• lpe234 / meizi_spider
  scrapy demo
  ☆25Updated 6 years ago
• yoghurtjia / Zhihu_bigdata
  使用scrapy和pandas完成对知乎300w用户的数据分析。首先使用scrapy爬取知乎网的300w，用户资料，最后使用pandas对数据进行过滤，找出想要的知乎大牛，并用图表的形式可视化。
  ☆158Updated 7 years ago
• CoolWell / wechat_spider
  基于搜狗微信入口的微信爬虫程序。 由基于phantomjs的python实现。 使用了收费的动态代理。 采集包括文章文本、阅读数、点赞数、评论以及评论赞数。 效率：500公众号/小时。 根据采集的公众号划分为多线程，可以实现并行采集。
  ☆233Updated 7 years ago