Alternatives and similar repositories for spider

Users that are interested in spider are comparing it to the libraries listed below

• code4craft / webmagic

  View on GitHub
  A scalable web crawler framework for Java.
  ☆11,697Dec 20, 2025Updated last month
• zhegexiaohuozi / SeimiCrawler

  View on GitHub
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,994Nov 25, 2024Updated last year
• CrawlScript / WebCollector

  View on GitHub
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,091Sep 5, 2025Updated 5 months ago
• brianway / webporter

  View on GitHub
  基于 webmagic 的 Java 爬虫应用
  ☆2,782Jan 8, 2022Updated 4 years ago
• webmagic-io / jobhunter

  View on GitHub
  使用WebMagic抓取招聘信息，并且持久化到Mysql的例子。
  ☆225Nov 22, 2016Updated 9 years ago
• xtuhcy / gecco

  View on GitHub
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,516Jan 23, 2026Updated 3 weeks ago
• jeff-dong / marble

  View on GitHub
  JOB调度框架
  ☆86Jul 11, 2017Updated 8 years ago
• hs-web / hsweb-framework

  View on GitHub
  hsweb (haʊs wɛb) 是一个基于spring-boot 2.x开发 ,首个使用全响应式编程的企业级后台管理系统基础项目。
  ☆8,408Updated this week
• Wizzercn / NutzWk

  View on GitHub
  WK系列开发框架-V1至V5 Java开源企业级开发框架(单应用/微服务/分布式)
  ☆1,613Oct 31, 2023Updated 2 years ago
• knightliao / disconf

  View on GitHub
  Distributed Configuration Management Platform(分布式配置管理平台)
  ☆5,541Jul 18, 2023Updated 2 years ago
• ihaolin / antares

  View on GitHub
  分布式任务调度平台(Distributed Job Schedule Platform)
  ☆560Jun 20, 2022Updated 3 years ago
• thinkgem / jeesite

  View on GitHub
  👍Java 低代码, 轻量级, Spring Boot, MyBatis, Flowable, TypeScript, Vue, Antdv, 包括核心模块如：组织机构、角色用户、权限授权、数据权限、内容管理、工作流、Spring Cloud 微服务等。
  ☆8,050Feb 4, 2026Updated last week
• NLPchina / elasticsearch-analysis-ansj

  View on GitHub
  ☆647Dec 16, 2025Updated last month
• mpusher / mpush

  View on GitHub
  MPush开源实时消息推送系统
  ☆3,779Jun 17, 2022Updated 3 years ago
• JPressProjects / jpress

  View on GitHub
  JPress，一个使用 Java 开发的建站神器，目前已经有 10w+ 网站使用 JPress 进行驱动，其中包括多个政府机构，200+上市公司，中科院、红+字会等。
  ☆2,730Nov 28, 2024Updated last year
• xuxueli / xxl-job

  View on GitHub
  A distributed task scheduling framework.（分布式任务调度平台XXL-JOB）
  ☆29,899Feb 9, 2026Updated last week
• ltsopensource / light-task-scheduler

  View on GitHub
  Distributed Scheduled Job Framework
  ☆3,014Oct 20, 2022Updated 3 years ago
• hemin1003 / java-spider

  View on GitHub
  一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。
  ☆343Nov 16, 2022Updated 3 years ago
• alibaba / jstorm

  View on GitHub
  Enterprise Stream Process Engine
  ☆3,889Jun 16, 2023Updated 2 years ago
• zhegexiaohuozi / SeimiAgent

  View on GitHub
  A headless,standalone webkit server which make grabing dynamic web page easier.
  ☆221Feb 15, 2019Updated 7 years ago
• zhegexiaohuozi / maven-seimicrawler-plugin

  View on GitHub
  Package seimicrawler project so that can be fast and standalone deployed.It is based on maven-war-plugin and modified. 这是专为SeimiCrawl…
  ☆14Jun 30, 2022Updated 3 years ago
• yasserg / crawler4j

  View on GitHub
  Open Source Web Crawler for Java
  ☆4,628Nov 4, 2021Updated 4 years ago
• binarywang / WxJava

  View on GitHub
  微信开发 Java SDK ，支持包括微信支付，开放平台，小程序，企业微信，视频号，公众号等的后端开发
  ☆32,553Feb 9, 2026Updated last week
• qiujiayu / AutoLoadCache

  View on GitHub
  AutoLoadCache 是基于AOP+Annotation等技术实现的高效的缓存管理解决方案，实现缓存与业务逻辑的解耦，并增加异步刷新及“拿来主义机制”，以适应高并发环境下的使用。
  ☆2,098Apr 1, 2024Updated last year
• pankai2014 / jserver

  View on GitHub
  Java server
  ☆42Nov 23, 2017Updated 8 years ago
• shuzheng / zheng

  View on GitHub
  基于Spring+SpringMVC+Mybatis分布式敏捷开发系统架构，提供整套公共微服务服务模块：集中权限管理（单点登录）、内容管理、支付中心、用户管理（支持第三方登录）、微信平台、存储系统、配置中心、日志分析、任务和通知等，支持服务治理、监控和追踪，努力为中小型企业…
  ☆16,715Dec 16, 2022Updated 3 years ago
• hankcs / HanLP

  View on GitHub
  中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理
  ☆36,131Nov 15, 2025Updated 3 months ago
• weibocom / motan

  View on GitHub
  A cross-language remote procedure call(RPC) framework for rapid development of high performance distributed services.
  ☆5,908Nov 24, 2025Updated 2 months ago
• alibaba / druid

  View on GitHub
  阿里云计算平台DataWorks(https://help.aliyun.com/document_detail/137663.html) 团队出品，为监控而生的数据库连接池
  ☆28,221Updated this week
• youseries / urule

  View on GitHub
  URULE是一款基于RETE算法的纯Java规则引擎，提供规则集、决策表、决策树、评分卡，规则流等各种规则表现工具及基于网页的可视化设计器，可快速开发出各种复杂业务规则。
  ☆1,937Dec 10, 2022Updated 3 years ago
• nutzam / nutz

  View on GitHub
  Nutz -- Web Framework(Mvc/Ioc/Aop/Dao/Json) for ALL Java developer
  ☆2,547Oct 28, 2025Updated 3 months ago
• gsh199449 / DistributedCrawler

  View on GitHub
  DistributeCrawler的Maven版
  ☆10Jun 20, 2022Updated 3 years ago
• apache / shardingsphere

  View on GitHub
  Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
  ☆20,674Updated this week
• dianping / cat

  View on GitHub
  CAT 作为服务端项目基础组件，提供了 Java, C/C++, Node.js, Python, Go 等多语言客户端，已经在美团点评的基础架构中间件框架（MVC框架，RPC框架，数据库框架，缓存框架等，消息队列，配置系统等）深度集成，为美团点评各业务线提供系统丰富的性能…
  ☆18,984Jan 4, 2025Updated last year
• xuxueli / xxl-crawler

  View on GitHub
  A lightweight web crawler framework.（Java爬虫框架）
  ☆751Dec 20, 2025Updated last month
• NLPchina / Jcoder

  View on GitHub
  Java Dynamic code or JAR , publish you Api or Schedule in flying
  ☆148Jul 28, 2020Updated 5 years ago
• apache / shardingsphere-elasticjob

  View on GitHub
  Distributed scheduled job
  ☆8,217Feb 7, 2026Updated last week
• Dreampie / Resty

  View on GitHub
  The minimalist framework of RESTful(server and client) - Resty
  ☆1,244Nov 5, 2021Updated 4 years ago
• apolloconfig / apollo

  View on GitHub
  Apollo is a reliable configuration management system suitable for microservice configuration management scenarios.
  ☆29,782Updated this week