Alternatives and similar repositories for magic_google

Users that are interested in magic_google are comparing it to the libraries listed below

• liuslnlp / ProxyPool
  跨语言IP代理池，Python实现。
  ☆355Updated 7 years ago
• mazzzystar / Proxy
  A simple tool for fetching usable proxies from several websites.
  ☆126Updated 4 years ago
• meibenjin / GoogleSearchCrawler
  a tool for crawl Google search results
  ☆399Updated 5 years ago
• LiuXingMing / LinkedinSpider
  Linkedin爬虫，根据公司名字抓取员工的linkedin信息
  ☆165Updated 8 years ago
• Python3WebSpider / WeiboCrawler
  Weibo Crawler for All Sites
  ☆30Updated 2 years ago
• Python3WebSpider / Weibo
  Weibo Spider Using Scrapy
  ☆137Updated 7 years ago
• hanxweb / Scrapy-SearchEngines
  bing、google、baidu搜索引擎爬虫。python3.6 and scrapy
  ☆45Updated 7 years ago
• mazzzystar / BaiduCrawler
  Sample of using proxies to crawl baidu search results.
  ☆118Updated 7 years ago
• Gerapy / GerapyAutoExtractor
  Auto Extractor Module
  ☆329Updated last year
• chenjiandongx / async-proxy-pool
  🔅 Python3 异步爬虫代理池
  ☆374Updated 6 years ago
• zezhix / html-extractor
  基于行块分布函数的通用网页正文抽取算法优化，Python实现
  ☆60Updated 5 years ago
• DotNetAge / scrapy_plus
  scrapy 常用爬网必备工具包
  ☆24Updated 2 years ago
• inlike / CookiePool
  一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式
  ☆231Updated 5 years ago
• Solin1998 / SearchTT
  Twitter crawler based on python
  ☆167Updated 5 years ago
• aox-lei / aox_proxy_pool
  本项目是为了解决在抓取代理ip后, 代理ip失效快, 不稳定的问题 以及代理ip使用不方便等问题。
  ☆143Updated 6 years ago
• chrislinan / cx-extractor-python
  基于行块分布函数的通用网页正文抽取算法的Python版本实现，添加了英文支持/ Web page content extraction algorithm, support both Chinese and English
  ☆484Updated 6 years ago
• Python3WebSpider / AdslProxy
  Adsl Proxy Pool
  ☆237Updated 2 years ago
• iofu728 / spider
  🕷some website spider application base on proxy pool (support http & websocket)
  ☆112Updated 3 years ago
• jhao104 / SSDBAdmin
  SSDB可视化界面管理工具 ssdb web manager tool
  ☆353Updated 2 years ago
• zhanghe06 / news_spider
  新闻抓取（微信、微博、头条...）
  ☆225Updated 2 years ago
• ChangxingJiang / CxSpider
  长行的爬虫集合：微博、Twitter、玩加、知网、虎牙、斗鱼、B站、WeGame、猫眼、豆瓣、安居客、居理新房
  ☆373Updated 4 years ago
• starFalll / Spider
  新浪微博爬虫(Sina weibo spider)，百度搜索结果 爬虫
  ☆195Updated 2 years ago
• Henryhaohao / Wenshu_Spider
  Wenshu_Spider-Scrapy框架爬取中国裁判文书网案件数据(2019-1-9最新版)
  ☆197Updated 6 years ago
• fate0 / getproxy
  getproxy 是一个抓取发放代理网站，获取 http/https 代理的程序
  ☆845Updated 3 years ago
• BruceDone / scrapy_demo
  all kinds of scrapy demo
  ☆165Updated 2 years ago
• Python3WebSpider / ScrapyUniversal
  Scrapy Universal Spider
  ☆55Updated 8 years ago
• striver-ing / distributed-spider
  通用新闻类网站分布式爬虫
  ☆78Updated 7 years ago
• yaleimeng / Free_proxy_pool
  对免费代理IP网站进行爬取，收集汇总为自己的代理池。关键是验证代理的有效性、匿名性、去重复
  ☆77Updated 3 years ago
• blackAndrechen / taobao_crawled
  淘宝爬虫命令行版，指定爬取淘宝商品和评论，利用selenium爬取商品信息，requests爬取评论信息。
  ☆94Updated 5 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆347Updated 2 years ago