Alternatives and similar repositories for files

Users that are interested in files are comparing it to the libraries listed below

• TurboWay / spiderman
  基于 scrapy-redis 的通用分布式爬虫框架
  ☆611Updated 2 years ago
• chrislinan / cx-extractor-python
  基于行块分布函数的通用网页正文抽取算法的Python版本实现，添加了英文支持/ Web page content extraction algorithm, support both Chinese and English
  ☆484Updated 5 years ago
• my8100 / scrapyd-cluster-on-heroku
  Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO
  ☆123Updated 5 years ago
• my8100 / scrapydweb
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,302Updated 4 months ago
• Gerapy / Gerapy
  Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
  ☆3,457Updated 7 months ago
• wanglian / workbase-server
  Slack alternative, email integrated, build with Meteor
  ☆281Updated 2 years ago
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆175Updated 3 years ago
• t9tio / wewe
  Open group chat messages to the world
  ☆348Updated 2 years ago
• fuckwonderfulsuccess / WCplus
  wonderfulsuccess 的 WCplus 最新版源码，已破解
  ☆238Updated 6 years ago
• liinnux / awesome-crawler-cn
  互联网爬虫，蜘蛛，数据采集器，网页解析器的汇总，因新技术不断发展，新框架层出不穷，此文会不断更新...
  ☆321Updated 2 years ago
• dequinns / ScrapydArt
  在scrapyd基础上新增权限验证、爬虫运行信息统计、界面重构、，并增加排序、筛选过滤等多个API
  ☆112Updated 6 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆346Updated 2 years ago
• da2vin / Sasila
  一个灵活、友好的爬虫框架
  ☆296Updated 2 years ago
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,767Updated 2 years ago
• phcp-tech / toolmaker
  Toolmaker is a lightweight software development life cycle management platform
  ☆87Updated 5 months ago
• csbun / thal
  译文：Puppeteer 与 Chrome Headless —— 从入门到爬虫
  ☆655Updated 6 years ago
• fate0 / getproxy
  getproxy 是一个抓取发放代理网站，获取 http/https 代理的程序
  ☆845Updated 2 years ago
• mouday / spider-admin-pro
  spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具，SpiderAdmin的升级版
  ☆596Updated 7 months ago
• scrapy / scrapyd-client
  Command line client for Scrapyd server
  ☆774Updated last month
• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆364Updated 3 months ago
• asyncspider / spiderexam
  爬虫工程师面试试题
  ☆149Updated 6 years ago
• djm / python-scrapyd-api
  A Python wrapper for working with Scrapyd's API.
  ☆271Updated 10 months ago
• ramsayleung / jd_spider
  Two dumb distributed crawlers
  ☆726Updated 6 years ago
• alphardex / looter
  Web-Scraping for Humans!
  ☆142Updated 2 years ago
• Bindian9710 / Spider-Crack_Js
  爬虫js解密、python解密 大众点评|中国移动|新浪微博|汽车之家|Steam|中华英才网|拼多多|36氪|今日头条... 欢迎Star
  ☆346Updated 4 years ago
• Python3WebSpider / DouYin
  API of DouYin for Humans used to Crawl Popular Videos and Musics
  ☆652Updated 5 years ago
• Gerapy / GerapyAutoExtractor
  Auto Extractor Module
  ☆327Updated 10 months ago
• Python3WebSpider / Weixin
  Sougou Weixin Spider Using Proxy
  ☆87Updated 4 years ago
• gavin66 / proxy_list
  爬取免费可用代理，供爬虫等工具使用
  ☆589Updated 6 years ago
• crawlab-team / crawlab-lite
  Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
  ☆227Updated 2 years ago