A configurable web spider with a easy-to-use web console
☆996Jun 3, 2026Updated 5 months ago
Alternatives and similar repositories for spider
Users that are interested in spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A scalable web crawler framework for Java.☆11,668Dec 20, 2025Updated 10 months ago
- 一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.☆1,986Oct 15, 2026Updated 3 weeks ago
- WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …☆3,078Feb 10, 2026Updated 8 months ago
- 使用WebMagic抓取招聘信息，并且持久化到Mysql的例子。☆220Nov 22, 2016Updated 9 years ago
- JOB调度框架☆86Jul 11, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 基于 webmagic 的 Java 爬虫应用☆2,765Jan 8, 2022Updated 4 years ago
- Easy to use lightweight web crawler（易用的轻量化网络爬虫）☆2,512Oct 9, 2026Updated 3 weeks ago
- 一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。☆338Nov 16, 2022Updated 3 years ago
- hsweb (haʊs wɛb) 是一个基于spring-boot 2.x开发 ,首个使用全 响应式编程的企业级后台管理系统基础项目。☆8,395Updated this week
- ☆646Aug 13, 2026Updated 2 months ago
- A headless,standalone webkit server which make grabing dynamic web page easier.☆221Feb 15, 2019Updated 7 years ago
- Distributed Configuration Management Platform(分布式配置管理平台)☆5,520Jul 18, 2023Updated 3 years ago
- 👍Java 低代码, 轻量级, Spring Boot, MyBatis, Flowable, TypeScript, Vue, Antdv, 包括核心模块如：组织机构、角色用户、权限授权、数据权限、内容管理、工作流、Spring Cloud 微服务等。☆8,045Oct 9, 2026Updated 3 weeks ago
- WK系列开发框架-V1至V5 Java开源企业级开发框架(单应用/微服务/分布式)☆1,610Oct 31, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- JPress，一个使用 Java 开发的建站神器，目前已经有 10w+ 网站使用 JPress 进行驱动，其中包括多个政府机构，200+上市公司，中科院、红+字会等。☆2,732Nov 28, 2024Updated last year
- When jsoup meets XPath.☆474Aug 9, 2026Updated 2 months ago
- zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目☆918Apr 2, 2019Updated 7 years ago
- Open Source Web Crawler for Java☆4,619Nov 4, 2021Updated 5 years ago
- A lightweight web crawler framework.（Java爬虫框架）☆757Aug 8, 2026Updated 3 months ago
- 阿里云计算平台DataWorks(https://help.aliyun.com/document_detail/137663.html) 团队出品，为监控而生的数据库连接池☆28,150Aug 1, 2026Updated 3 months ago
- 基于Spring+SpringMVC+Mybatis分布式敏捷开发系统架构，提供整套公共微服务服务模块：集中权限管理（单点登录）、内容管理、支付中心、用户管理（支持第三方登录）、微信平台、存储系统、配置中心、日志分析、任务和通知等，支持服务治理、监控和追踪，努力为中小型企业…☆16,629Dec 16, 2022Updated 3 years ago
- A distributed task scheduling framework.（分布式任务调度平台XXL-JOB）☆30,654Oct 9, 2026Updated 3 weeks ago
- MPush开源实时消息推送系统☆3,766Jun 17, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- a simple distributed spider in Java. Java编写的一个简单分布式爬虫☆160Jun 18, 2013Updated 13 years ago
- 利用spring boot + webmagic 开发的java爬虫系统☆60Dec 29, 2016Updated 9 years ago
- 微信开发 Java SDK ，支持包括微信支付，开放平台，小程序，企业微信，视频号，公众号等的后端开发☆33,186Updated this week
- 分布式任务调度平台(Distributed Job Schedule Platform)☆559Jun 20, 2022Updated 4 years ago
- Distributed Scheduled Job Framework☆2,992Oct 20, 2022Updated 4 years ago
- The vip.com's java coding standard, libraries and tools☆7,604Sep 6, 2023Updated 3 years ago
- Apollo is a reliable configuration management system suitable for microservice configuration management scenarios.☆29,815Updated this week
- The java implementation of Apache Dubbo. An RPC and microservice framework.☆41,573Updated this week
- "奇伢爬虫"是基于sprint boot 、 WebMagic 实现 微信公众号文章、新闻、csdn、info等网站文章爬取，可以动态设置文章爬取规则、清洗规则，基本实现了爬取大部分网站的文章。☆323Sep 3, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- AutoLoadCache 是基于AOP+Annotation等技术实现的高效的缓存管理解决方案，实现缓存与业务逻辑的解耦，并增加异步刷新及“拿来主义机制”，以适应高并发环境下的使用。☆2,075Apr 1, 2024Updated 2 years ago
- NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。☆643Jun 5, 2026Updated 5 months ago
- Nutz -- Web Framework(Mvc/Ioc/Aop/Dao/Json) for ALL Java developer☆2,538Aug 4, 2026Updated 3 months ago
- CAT 作为服务端项目基础组件，提供了 Java, C/C++, Node.js, Python, Go 等多语言客户端，已经在美团点评的基础架构中间件框架（MVC框架，RPC框架，数据库框架，缓存框架等，消息队列，配置系统等）深度集成，为美团点评各业务线提供系统丰富的性能…☆18,935Jan 4, 2025Updated last year
- 基于webmagic + springboot + mybatis的Java爬虫，使用Echarts进行数据可视化分析，提供了从爬虫获取数据到数据持久化、数据可视化分析以及构建简单的代理池等一整套解决方案模板。☆366Oct 26, 2017Updated 9 years ago
- A cross-language remote procedure call(RPC) framework for rapid development of high performance distributed services.☆5,859Nov 24, 2025Updated 11 months ago
- Natural Language Processing for the next decade. Tokenization, Part-of-Speech Tagging, Named Entity Recognition, Syntactic & Semantic Dep…☆36,536Updated this week