Alternatives and similar repositories for magic_google

Users that are interested in magic_google are comparing it to the libraries listed below

• meibenjin / GoogleSearchCrawler
  a tool for crawl Google search results
  ☆400Updated 6 years ago
• mazzzystar / Proxy
  A simple tool for fetching usable proxies from several websites.
  ☆126Updated 5 years ago
• liuslnlp / ProxyPool
  跨语言IP代理池，Python实现。
  ☆354Updated 7 years ago
• mazzzystar / BaiduCrawler
  Sample of using proxies to crawl baidu search results.
  ☆118Updated 7 years ago
• LiuXingMing / LinkedinSpider
  Linkedin爬虫，根据公司名字抓取员工的linkedin信息
  ☆166Updated 8 years ago
• Python3WebSpider / Weibo
  Weibo Spider Using Scrapy
  ☆137Updated 7 years ago
• chenjiandongx / async-proxy-pool
  🔅 Python3 异步爬虫代理池
  ☆373Updated 6 years ago
• aox-lei / aox_proxy_pool
  本项目是为了解决在抓取代理ip后, 代理ip失效快, 不稳定的问题 以及代理ip使用不方便等问题。
  ☆143Updated 6 years ago
• Python3WebSpider / AdslProxy
  Adsl Proxy Pool
  ☆237Updated 2 years ago
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆176Updated 4 years ago
• Python3WebSpider / WeiboCrawler
  Weibo Crawler for All Sites
  ☆30Updated 2 years ago
• Gerapy / GerapyAutoExtractor
  Auto Extractor Module
  ☆329Updated last year
• inlike / CookiePool
  一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式
  ☆233Updated 5 years ago
• MogicianXD / ZhihuCrawler
  知乎2019-2020完美爬取方案（自动登录+自动识别验证码）+数据分析
  ☆56Updated 4 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆347Updated 2 years ago
• yaleimeng / Free_proxy_pool
  对免费代理IP网站进行爬取，收集汇总为自己的代理池。关键是验证代理的有效性、匿名性、去重复
  ☆78Updated 3 years ago
• zezhix / html-extractor
  基于行块分布函数的通用网页正文抽取算法优化，Python实现
  ☆61Updated 5 years ago
• hanxweb / Scrapy-SearchEngines
  bing、google、baidu搜索引擎爬虫。python3.6 and scrapy
  ☆46Updated 7 years ago
• Python3WebSpider / ScrapyUniversal
  Scrapy Universal Spider
  ☆55Updated 8 years ago
• dytttf / antispider
  ☆108Updated 6 years ago
• zhanghe06 / news_spider
  新闻抓取（微信、微博、头条...）
  ☆225Updated 2 years ago
• kohn / HttpProxyMiddleware
  A middleware for scrapy. Used to change HTTP proxy from time to time.
  ☆323Updated 7 years ago
• sixs / wenshu_spider
  中国裁判文书网爬虫(2018-08-28更新)
  ☆347Updated 2 years ago
• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆366Updated 6 months ago
• Solin1998 / SearchTT
  Twitter crawler based on python
  ☆167Updated 5 years ago
• monkey-soft / Scrapy_IPProxyPool
  免费 IP 代理池。Scrapy 爬虫框架插件
  ☆103Updated 7 years ago
• qcl643062 / spider
  ☆30Updated 9 years ago
• starFalll / Spider
  新浪微博爬虫(Sina weibo spider)，百度搜索结果 爬虫
  ☆195Updated 2 years ago
• striver-ing / distributed-spider
  通用新闻类网站分布式爬虫
  ☆78Updated 7 years ago
• fate0 / getproxy
  getproxy 是一个抓取发放代理网站，获取 http/https 代理的程序
  ☆845Updated 3 years ago