Alternatives and similar repositories for files:

Users that are interested in files are comparing it to the libraries listed below

• TurboWay / spiderman
  基于 scrapy-redis 的通用分布式爬虫框架
  ☆599Updated last year
• my8100 / scrapyd-cluster-on-heroku
  Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO
  ☆122Updated 4 years ago
• dequinns / ScrapydArt
  在scrapyd基础上新增权限验证、爬虫运行信息统计、界面重构、，并增加排序、筛选过滤等多个API
  ☆112Updated 6 years ago
• chrislinan / cx-extractor-python
  基于行块分布函数的通用网页正文抽取算法的Python版本实现，添加了英文支持/ Web page content extraction algorithm, support both Chinese and English
  ☆483Updated 5 years ago
• ramsayleung / jd_spider
  Two dumb distributed crawlers
  ☆727Updated 5 years ago
• da2vin / Sasila
  一个灵活、友好的爬虫框架
  ☆297Updated 2 years ago
• Windsooon / cherry
  text classification - no machine learning knowledge needed
  ☆500Updated last year
• alphardex / looter
  Web-Scraping for Humans!
  ☆141Updated 2 years ago
• phcp-tech / toolmaker
  Toolmaker is a lightweight software development life cycle management platform
  ☆87Updated 2 months ago
• zhanghe06 / news_spider
  新闻抓取（微信、微博、头条...）
  ☆225Updated 2 years ago
• my8100 / scrapydweb
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,250Updated last month
• fuckwonderfulsuccess / WCplus
  wonderfulsuccess 的 WCplus 最新版源码，已破解
  ☆238Updated 5 years ago
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆176Updated 3 years ago
• Karmenzind / fp-server
  Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池
  ☆159Updated last year
• t9tio / wewe
  Open group chat messages to the world
  ☆349Updated 2 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆350Updated 2 years ago
• wanglian / workbase-server
  Slack alternative, email integrated, build with Meteor
  ☆282Updated 2 years ago
• asyncspider / spiderexam
  爬虫工程师面试试题
  ☆149Updated 6 years ago
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,761Updated last year
• jhao104 / SSDBAdmin
  SSDB可视化界面管理工具 ssdb web manager tool
  ☆353Updated last year
• Python3WebSpider / CookiesPool
  Cookies Pool
  ☆578Updated 4 years ago
• chenjiandongx / async-proxy-pool
  🔅 Python3 异步爬虫代理池
  ☆374Updated 6 years ago
• liinnux / awesome-crawler-cn
  互联网爬虫，蜘蛛，数据采集器，网页解析器的汇总，因新技术不断发展，新框架层出不穷，此文会不断更新...
  ☆317Updated 2 years ago
• lijinma / wechat_spider
  使用“代理”的方式来抓取微信公众账号文章，可以抓取阅读数、点赞数，基于 anyproxy。
  ☆949Updated 4 years ago
• Gerapy / GerapyAutoExtractor
  Auto Extractor Module
  ☆327Updated 7 months ago
• scrapy / scrapyd-client
  Command line client for Scrapyd server
  ☆773Updated 2 weeks ago
• jaryee / wechat_sogou_crawl
  基于搜狗微信的公众号文章爬虫
  ☆228Updated last year
• wdkwdkwdk / fuck_illness
  写疾病数据分析用到的所有东西
  ☆198Updated 5 years ago
• JustForFunnnn / webspider
  A website of IT position data & analysis, helps you to get a better understanding of the requirements and trends of the IT job market
  ☆371Updated last year
• ao / ktmm
  Keep That Mouse Moving!
  ☆74Updated 2 years ago