Alternatives and similar repositories for files

Users that are interested in files are comparing it to the libraries listed below

• TurboWay / spiderman
  基于 scrapy-redis 的通用分布式爬虫框架
  ☆609Updated 2 years ago
• my8100 / scrapyd-cluster-on-heroku
  Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO
  ☆123Updated 5 years ago
• da2vin / Sasila
  一个灵活、友好的爬虫框架
  ☆296Updated 2 years ago
• t9tio / wewe
  Open group chat messages to the world
  ☆349Updated 2 years ago
• Windsooon / cherry
  text classification - no machine learning knowledge needed
  ☆502Updated last year
• chrislinan / cx-extractor-python
  基于行块分布函数的通用网页正文抽取算法的Python版本实现，添加了英文支持/ Web page content extraction algorithm, support both Chinese and English
  ☆484Updated 5 years ago
• wanglian / workbase-server
  Slack alternative, email integrated, build with Meteor
  ☆281Updated 2 years ago
• dequinns / ScrapydArt
  在scrapyd基础上新增权限验证、爬虫运行信息统计、界面重构、，并增加排序、筛选过滤等多个API
  ☆112Updated 6 years ago
• asyncspider / spiderexam
  爬虫工程师面试试题
  ☆149Updated 6 years ago
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,764Updated 2 years ago
• phcp-tech / toolmaker
  Toolmaker is a lightweight software development life cycle management platform
  ☆87Updated 5 months ago
• csbun / thal
  译文：Puppeteer 与 Chrome Headless —— 从入门到爬虫
  ☆656Updated 6 years ago
• alphardex / looter
  Web-Scraping for Humans!
  ☆142Updated 2 years ago
• scrapy / scrapyd-client
  Command line client for Scrapyd server
  ☆772Updated last week
• mouday / spider-admin-pro
  spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具，SpiderAdmin的升级版
  ☆595Updated 6 months ago
• da2vin / fetchman
  fetchman is a simple crawler system/简单好用的爬虫框架
  ☆78Updated 2 years ago
• jxlwqq / id-validator.py
  中华人民共和国居民身份证、中华人民共和国港澳居民居住证以及中华人民共和国台湾居民居住证号码验证工具（Python 版）
  ☆368Updated 3 years ago
• 9468305 / python-script
  My Python Script
  ☆195Updated last year
• CasterWx / kibana-eye
  ELK数据报表定时任务管理平台，定时任务统计上报应用性能指标(基于时间轮)
  ☆24Updated 4 years ago
• Germey / AwesomeWebSpider
  Awesome WebSpider
  ☆81Updated 6 years ago
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆175Updated 3 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆346Updated 2 years ago
• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆362Updated 2 months ago
• flaggo / pydu
  Useful data structures and utils for Python.
  ☆338Updated 3 years ago
• djm / python-scrapyd-api
  A Python wrapper for working with Scrapyd's API.
  ☆271Updated 10 months ago
• zhangslob / docs
  《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用n…
  ☆138Updated 5 years ago
• polyrabbit / WeCron
  微信上的定时提醒 - Cron on WeChat
  ☆684Updated last week
• lijinma / wechat_spider
  使用“代理”的方式来抓取微信公众账号文章，可以抓取阅读数、点赞数，基于 anyproxy。
  ☆951Updated 4 years ago
• Gerapy / GerapyPyppeteer
  Downloader Middleware to support Pyppeteer in Scrapy & Gerapy
  ☆135Updated 3 years ago
• derekhe / ProxyPool
  高质量免费代理池——每日1w+代理资源滚动更新
  ☆300Updated 3 years ago