Alternatives and similar repositories for magic_google

Users that are interested in magic_google are comparing it to the libraries listed below

• meibenjin / GoogleSearchCrawler
  a tool for crawl Google search results
  ☆401Updated 5 years ago
• mazzzystar / Proxy
  A simple tool for fetching usable proxies from several websites.
  ☆126Updated 4 years ago
• mazzzystar / BaiduCrawler
  Sample of using proxies to crawl baidu search results.
  ☆118Updated 7 years ago
• liuslnlp / ProxyPool
  跨语言IP代理池，Python实现。
  ☆354Updated 7 years ago
• LiuXingMing / LinkedinSpider
  Linkedin爬虫，根据公司名字抓取员工的linkedin信息
  ☆165Updated 8 years ago
• xtt129 / seCrawler
  A scrapy project can crawl search result of Google/Bing/Baidu
  ☆75Updated 7 years ago
• hanxweb / Scrapy-SearchEngines
  bing、google、baidu搜索引擎爬虫。python3.6 and scrapy
  ☆46Updated 7 years ago
• Python3WebSpider / Weibo
  Weibo Spider Using Scrapy
  ☆137Updated 7 years ago
• aox-lei / aox_proxy_pool
  本项目是为了解决在抓取代理ip后, 代理ip失效快, 不稳定的问题 以及代理ip使用不方便等问题。
  ☆143Updated 6 years ago
• chenjiandongx / async-proxy-pool
  🔅 Python3 异步爬虫代理池
  ☆372Updated 6 years ago
• zezhix / html-extractor
  基于行块分布函数的通用网页正文抽取算法优化，Python实现
  ☆61Updated 5 years ago
• Gerapy / GerapyAutoExtractor
  Auto Extractor Module
  ☆329Updated last year
• Solin1998 / SearchTT
  Twitter crawler based on python
  ☆167Updated 5 years ago
• Karmenzind / fp-server
  Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池
  ☆159Updated 2 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆94Updated 7 years ago
• zhangslob / awesome_crawl
  腾讯新闻、知乎话题、微博粉丝，Tumblr爬虫、斗鱼弹幕、妹子图爬虫、分布式设计等
  ☆296Updated 3 months ago
• zhanghe06 / news_spider
  新闻抓取（微信、微博、头条...）
  ☆225Updated 2 years ago
• yaleimeng / Free_proxy_pool
  对免费代理IP网站进行爬取，收集汇总为自己的代理池。关键是验证代理的有效性、匿名性、去重复
  ☆77Updated 3 years ago
• Python3WebSpider / WeiboCrawler
  Weibo Crawler for All Sites
  ☆30Updated 2 years ago
• SuperSaiyanSSS / SinaWeiboSpider
  新浪微博较为完善的爬虫，持续改进 2017/8/4 更新
  ☆16Updated last year
• starFalll / Spider
  新浪微博爬虫(Sina weibo spider)，百度搜索结果 爬虫
  ☆195Updated 2 years ago
• ioiogoo / scrapy-monitor
  scrapy-monitor，实现爬虫可视化，监控实时状态
  ☆110Updated 8 years ago
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆176Updated 4 years ago
• Python3WebSpider / AdslProxy
  Adsl Proxy Pool
  ☆237Updated 2 years ago
• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆365Updated 6 months ago
• striver-ing / distributed-spider
  通用新闻类网站分布式爬虫
  ☆78Updated 7 years ago
• fengzhizi715 / user-agent-list
  常用浏览器的user-agent列表
  ☆255Updated 5 years ago
• BruceDone / scrapy_demo
  all kinds of scrapy demo
  ☆164Updated 2 years ago
• inlike / CookiePool
  一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式
  ☆233Updated 5 years ago
• Henryhaohao / Wenshu_Spider
  Wenshu_Spider-Scrapy框架爬取中国裁判文书网案件数据(2019-1-9最新版)
  ☆196Updated 6 years ago