A configurable web spider with a easy-to-use web console
☆997Jun 3, 2026Updated 4 months ago
Alternatives and similar repositories for spider
Users that are interested in spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A scalable web crawler framework for Java.☆11,670Dec 20, 2025Updated 9 months ago
- 一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.☆1,986Aug 31, 2026Updated last month
- WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …☆3,080Feb 10, 2026Updated 8 months ago
- 使用WebMagic抓取招聘信息，并且持久化到Mysql的例子。☆220Nov 22, 2016Updated 9 years ago
- JOB调度框架☆86Jul 11, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 基于 webmagic 的 Java 爬虫应用☆2,765Jan 8, 2022Updated 4 years ago
- Easy to use lightweight web crawler（易用的轻量化网络爬虫）☆2,513Oct 9, 2026Updated last week
- ☆646Aug 13, 2026Updated 2 months ago
- 一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。☆338Nov 16, 2022Updated 3 years ago
- hsweb (haʊs wɛb) 是一个基于spring-boot 2.x开发 ,首个使用全响应式编程的企业级后台管理系统基础项目。☆8,397Updated this week
- Distributed Configuration Management Platform(分布式配置管理平台)☆5,517Jul 18, 2023Updated 3 years ago
- WK系列开发框架-V1至V5 Java开源企业级开发框架(单应用/微服务/分布式)☆1,609Oct 31, 2023Updated 2 years ago
- A headless,standalone webkit server which make grabing dynamic web page easier.☆221Feb 15, 2019Updated 7 years ago
- JPress，一个使用 Java 开发的建站神器，目前已经有 10w+ 网站使用 JPress 进行驱动，其中包括多个政府机构，200+上市公司，中科院、红+字会等。☆2,733Nov 28, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 👍Java 低代码, 轻量级, Spring Boot, MyBatis, Flowable, TypeScript, Vue, Antdv, 包括核心模块如：组织机构、角色用户、权限授权、数据权限、内容管理、工作流、Spring Cloud 微服务等。☆8,047Oct 9, 2026Updated last week
- MPush开源实时消息推送系统☆3,767Jun 17, 2022Updated 4 years ago
- A distributed task scheduling framework.（分布式任务调度平台XXL-JOB）☆30,619Oct 9, 2026Updated last week
- a simple distributed spider in Java. Java编写的一个简单分布式爬虫☆160Jun 18, 2013Updated 13 years ago
- A lightweight web crawler framework.（Java爬虫框架）☆756Aug 8, 2026Updated 2 months ago
- Open Source Web Crawler for Java☆4,620Nov 4, 2021Updated 4 years ago
- When jsoup meets XPath.☆474Aug 9, 2026Updated 2 months ago
- 基于Spring+SpringMVC+Mybatis分布式敏捷开发系统架构，提供整套公共微服务服务模块：集中权限管理（单点登录）、内容管理、支付中心、用户管理（支持第三方登录）、微信平台、存储系统、配置中心、日志分析、任务和通知等，支持服务治理、监控和追踪，努力为中小型企业…☆16,635Dec 16, 2022Updated 3 years ago
- Distributed Scheduled Job Framework☆2,991Oct 20, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Natural Language Processing for the next decade. Tokenization, Part-of-Speech Tagging, Named Entity Recognition, Syntactic & Semantic Dep…☆36,515Sep 15, 2026Updated last month
- 阿里云计算平台DataWorks(https://help.aliyun.com/document_detail/137663.html) 团队出品，为监控而生的数据库连接池☆28,166Aug 1, 2026Updated 2 months ago
- 微信开发 Java SDK ，支持包括微信支付，开放平台，小程序，企业微信，视频号，公众号等的后端开发☆33,163Updated this week
- DistributeCrawler的Maven版☆10Jun 20, 2022Updated 4 years ago
- zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目☆920Apr 2, 2019Updated 7 years ago
- 分布式任务调度平台(Distributed Job Schedule Platform)☆559Jun 20, 2022Updated 4 years ago
- A cross-language remote procedure call(RPC) framework for rapid development of high performance distributed services.☆5,863Nov 24, 2025Updated 10 months ago
- The java implementation of Apache Dubbo. An RPC and microservice framework.☆41,585Updated this week
- Enterprise Stream Process Engine☆3,866Jun 16, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Package seimicrawler project so that can be fast and standalone deployed.It is based on maven-war-plugin and modified. 这是专为SeimiCrawl…☆14Jun 30, 2022Updated 4 years ago
- AutoLoadCache 是基于AOP+Annotation等技术实现的高效的缓存管理解决方案，实现缓存与业务逻辑的解耦，并增加异步刷新及“拿来主义机制”，以适应高并发环境下的使用。☆2,076Apr 1, 2024Updated 2 years ago
- Apollo is a reliable configuration management system suitable for microservice configuration management scenarios.☆29,822Updated this week
- CAT 作为服务端项目基础组件，提供了 Java, C/C++, Node.js, Python, Go 等多语言客户端，已经在美团点评的基础架构中间件框架（MVC框架，RPC框架，数据库框架，缓存框架等，消息队列，配置系统等）深度集成，为美团点评各业务线提供系统丰富的性能…☆18,934Jan 4, 2025Updated last year
- The vip.com's java coding standard, libraries and tools☆7,612Sep 6, 2023Updated 3 years ago
- Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.☆20,809Updated this week
- 给爬虫使用的代理IP池☆564Sep 6, 2019Updated 7 years ago