Alternatives and similar repositories for magic_google:

Users that are interested in magic_google are comparing it to the libraries listed below

• xtt129 / seCrawler
  A scrapy project can crawl search result of Google/Bing/Baidu
  ☆75Updated 7 years ago
• LiuXingMing / LinkedinSpider
  Linkedin爬虫，根据公司名字抓取员工的linkedin信息
  ☆162Updated 7 years ago
• mazzzystar / Proxy
  A simple tool for fetching usable proxies from several websites.
  ☆127Updated 4 years ago
• mazzzystar / BaiduCrawler
  Sample of using proxies to crawl baidu search results.
  ☆118Updated 7 years ago
• liuslnlp / ProxyPool
  跨语言IP代理池，Python实现。
  ☆355Updated 7 years ago
• hanxweb / Scrapy-SearchEngines
  bing、google、baidu搜索引擎爬虫。python3.6 and scrapy
  ☆45Updated 7 years ago
• Python3WebSpider / AdslProxy
  Adsl Proxy Pool
  ☆236Updated 2 years ago
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆175Updated 3 years ago
• Python3WebSpider / Weibo
  Weibo Spider Using Scrapy
  ☆137Updated 7 years ago
• Germey / CookiesPool
  CookiesPool Based on Redis
  ☆153Updated 7 years ago
• muscledreamer / twitter_scrapy
  Use Scrapy to crwal Twitter .THE 1.0 Edition
  ☆56Updated 5 years ago
• inlike / CookiePool
  一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式
  ☆228Updated 5 years ago
• Gerapy / GerapyAutoExtractor
  Auto Extractor Module
  ☆329Updated 8 months ago
• chenjiandongx / async-proxy-pool
  🔅 Python3 异步爬虫代理池
  ☆374Updated 6 years ago
• fate0 / getproxy
  getproxy 是一个抓取发放代理网站，获取 http/https 代理的程序
  ☆844Updated 2 years ago
• Python3WebSpider / WeiboCrawler
  Weibo Crawler for All Sites
  ☆30Updated last year
• zhanghe06 / news_spider
  新闻抓取（微信、微博、头条...）
  ☆225Updated 2 years ago
• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆364Updated last month
• ioiogoo / scrapy-monitor
  scrapy-monitor，实现爬虫可视化，监控实时状态
  ☆109Updated 8 years ago
• skynetbinary / major-scrapy-spiders
  Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon
  ☆287Updated 7 years ago
• chrislinan / cx-extractor-python
  基于行块分布函数的通用网页正文抽取算法的Python版本实现，添加了英文支持/ Web page content extraction algorithm, support both Chinese and English
  ☆484Updated 5 years ago
• yaleimeng / Free_proxy_pool
  对免费代理IP网站进行爬取，收集汇总为自己的代理池。关键是验证代理的有效性、匿名性、去重复
  ☆78Updated 3 years ago
• Python3WebSpider / ScrapyUniversal
  Scrapy Universal Spider
  ☆56Updated 7 years ago
• fengzhizi715 / user-agent-list
  常用浏览器的user-agent列表
  ☆252Updated 5 years ago
• qcl643062 / spider
  ☆30Updated 8 years ago
• chenjiandongx / Github-spider
  Github 仓库及用户分析爬虫
  ☆267Updated 7 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆93Updated 7 years ago
• aox-lei / aox_proxy_pool
  本项目是为了解决在抓取代理ip后, 代理ip失效快, 不稳定的问题 以及代理ip使用不方便等问题。
  ☆143Updated 5 years ago
• Germey / ADSLProxyPool
  Adsl Proxy Pool
  ☆134Updated 6 years ago
• gavin66 / proxy_list
  爬取免费可用代理，供爬虫等工具使用
  ☆588Updated 6 years ago