豆瓣电影爬虫——a crawler which is able to crawl movie detail and short comments, save them to database mysql, also include Sentiment analysis based on comments
☆69Mar 24, 2019Updated 7 years ago
Alternatives and similar repositories for JewelCrawler
Users that are interested in JewelCrawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Crawler-for-Douban☆16Mar 29, 2017Updated 9 years ago
- 基于Map/Reduce爬虫,可抽取各大新闻网站的新闻正文并进行分类和聚类☆73Jan 5, 2014Updated 12 years ago
- 权限管理平台☆18Jul 2, 2017Updated 9 years ago
- GuozhongCrawler的是一个无须配置、便于二次开发的爬虫开源框架，它提供简单灵活的API，只需少量代码即可实现一个爬虫。其设计灵感来源于多个爬虫国内外爬虫框架的总结。采用完全模块化的设计，功能覆盖整个爬虫的生命周期(链接提取、页面下载、内容抽取、持久化)，支持多线…☆103Apr 20, 2015Updated 11 years ago
- 慕课网课程「快速上手Ionic3 多平台开发企业级问答社区」配套源码☆24Mar 6, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 一个快速，简单，基于多线程的网络爬虫框架☆13Mar 3, 2017Updated 9 years ago
- 华 南理工大学高英实验室进行的分布式爬虫项目,除了实验室内部人员外,不得私自传播.☆21Jul 13, 2014Updated 11 years ago
- 豆瓣爬虫 爬取热门标签、图书信息、图书评论 系统架构 Webmagic+SSM+Redis+Mysql+ActiveMQ+Druid☆44Apr 24, 2019Updated 7 years ago
- 基于selenium封装chrome、firefox、phantomjs等实现☆14Nov 15, 2017Updated 8 years ago
- 知网、万方、专利局爬虫☆11Mar 20, 2019Updated 7 years ago
- java爬虫，反爬虫策略、ETL清洗数据，以及spark离线和实时分析新闻并存入ES☆19Nov 26, 2018Updated 7 years ago
- 基于WebCollector的新浪微博爬虫及相关登录工具，如新浪微博Cookie获取☆14Nov 21, 2018Updated 7 years ago
- Web/FileSystem Crawler Library☆37Jun 25, 2026Updated last week
- 测试 Spring 事务的各种传播行为☆13Apr 27, 2014Updated 12 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Spark混合推荐系统大数据监控平台☆11May 1, 2018Updated 8 years ago
- 一些后台开发中常用的活动算法，大转盘，翻牌，刮刮卡，抢红包，洗牌 and so on ...☆12Dec 27, 2019Updated 6 years ago
- 读书笔记《自己动手写网络爬虫》，自己敲的代码。主要记录了网络爬虫的基本实现，网页去重的算法，网页指纹算法，文本信息挖掘☆47Jan 9, 2015Updated 11 years ago
- "奇伢爬虫"是基于sprint boot 、 WebMagic 实现 微信公众号文章、新闻、csdn、info等网站文章爬取，可以动态设置文章爬取规则、清洗规则，基本实现了爬取大部分网站的文章。☆323Sep 3, 2017Updated 8 years ago
- OA 注解零配置二次开发架构☆11Sep 17, 2016Updated 9 years ago
- A client library for the IPFS Cluster HTTP API, implemented in Java.☆10May 10, 2018Updated 8 years ago
- 网易 梦幻西游手游☆13Nov 13, 2019Updated 6 years ago
- a demo project using commons-pools and commons-net to interact with ftp server☆24Apr 11, 2026Updated 2 months ago
- ☆15Aug 17, 2017Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Reduced version of BitcoinJ used in RskJ☆11Updated this week
- ☆12Mar 7, 2016Updated 10 years ago
- Chinese analysis plugin which using IK analysis for Elasticsearch☆22Sep 4, 2015Updated 10 years ago
- java中将有子父级关系的list集合转出树形结构☆13Jun 17, 2022Updated 4 years ago
- 构建视频云服务的开源软件☆10Sep 30, 2015Updated 10 years ago
- BMR服务Java样例☆12Aug 8, 2016Updated 9 years ago
- 1、支持网页爬虫 2、多线程、线程池 3、支持全文搜索 4、支持Hadoop分布式平台、HDFS/MapReduce、Zookeeper、HBase 5、支持redis分布式缓存 6、集成微信公众号开发 7、Spring4新特性 8、ActiveMQ 9、Nginx详细配置…☆16Nov 16, 2022Updated 3 years ago
- 一个强大的工具，基于 Postman 接口自动化场景设计☆10May 30, 2026Updated last month
- rmarkdown-xaringan-slides☆11Jun 2, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Jhipster with Apache Kafka☆14Aug 29, 2017Updated 8 years ago
- 2019 年开源年度报告☆11Jan 7, 2020Updated 6 years ago
- HttpClient + Jsoup + Queue☆36Dec 12, 2016Updated 9 years ago
- Lock tailing on your rotating files☆12Dec 4, 2019Updated 6 years ago
- 各种网站爬虫合集，持续更新中....☆19Mar 26, 2019Updated 7 years ago
- Robotic Process Automation with Blue Prism Quick Start Guide☆16Jan 18, 2023Updated 3 years ago
- zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目☆920Apr 2, 2019Updated 7 years ago