项目整体分为scrapy-redis分布式爬虫爬取数据、基于ElasticSearch数据检索和前端界面展示三大模块。做此项目是为了熟悉scrapy-redis的基本流程，以及其背后的原理，同时熟悉ElasticSearch的使用。本项目可以作为一个基于ES存储的简单但是相对全面的全栈开发的Demo。项目中所采用的组件均在win10本地环境搭建（伪分布），旨在演示项目流程。你可以参考该项目，并将其扩展到多个主机上，实现分布式ES以及分布式Scrapy。
☆24Dec 8, 2022Updated 3 years ago
Alternatives and similar repositories for JobNews-ElasticSearch-Scrapy_redis
Users that are interested in JobNews-ElasticSearch-Scrapy_redis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于Scrapy+Elasticsearch+Django搭建的分布式电影搜索☆31Jul 25, 2018Updated 7 years ago
- 🕷️ [Graduation Project] Scrapy-Redis distributed crawler + Elasticsearch search engine + Django full-stack application; 论文搜索引擎（含Scrapy-R…☆42Feb 18, 2023Updated 3 years ago
- ElasticSearch+Django+Scrapy搜索引擎☆28Dec 8, 2022Updated 3 years ago
- Scrapy+Selenium+Django政府网站爬虫☆13Jul 22, 2019Updated 6 years ago
- 用scrapy框架爬虫爬取小说导入数据库并用django框架搭建自己的小说网站☆10Jan 10, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- python搭建搜索引擎☆30May 5, 2022Updated 4 years ago
- 通过django将scrapy爬取存储到mongodb的数据展示到web页面，增删改查等功能☆13Aug 16, 2018Updated 7 years ago
- 基于Scrapy和Django的二手房爬虫及可视化☆10Nov 22, 2022Updated 3 years ago
- 基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】☆13Feb 29, 2024Updated 2 years ago
- Scrapy, tianya, 天涯; scrapy django增量抓取天涯莲蓬鬼话全部帖子☆21Mar 20, 2025Updated last year
- elasticsearch7.9 cdh-ext-parcels and single machine multi instance☆10Jul 12, 2021Updated 4 years ago
- 史上最全编程语言xmind思维导图总结 包含python/php/flask/爬虫/javascript/mysql/nosql/git☆25Jun 29, 2021Updated 4 years ago
- ☆12May 3, 2024Updated 2 years ago
- 本项目包含几种常用 NLP算法的实现：关键词(keyword)、命名实体(named entity)、自动摘要(abstract)、文本相似度比较(text similarity)等☆16Jan 16, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Performing Latent Semantic Analysis with Python on large datasets.☆13Jun 21, 2022Updated 3 years ago
- 一个基于elasticsearch开发的搜索引擎网站☆14Nov 22, 2022Updated 3 years ago
- 租房网站信息分析项目（Vue+Django+Scrapy）☆26Jun 19, 2020Updated 5 years ago
- 静态站 用vue-element-admin框架搭建☆12Dec 4, 2018Updated 7 years ago
- 一个简易的正则表达式引擎!☆10Apr 9, 2017Updated 9 years ago
- 网站监控☆11Nov 9, 2019Updated 6 years ago
- Demo SoC☆10Oct 17, 2023Updated 2 years ago
- 主要使用python+Scrapy框架去抓取新闻网站☆25Mar 2, 2017Updated 9 years ago
- ☆21Jan 9, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10Dec 23, 2020Updated 5 years ago
- MySQL storage for OAuth 2.0☆13Mar 13, 2022Updated 4 years ago
- 8 bit CPU implemented on top of a Digital Circuit Simulator in TypeScript☆12May 15, 2025Updated last year
- 国家税务总局全国增值税发票查验平台☆15Dec 16, 2020Updated 5 years ago
- A Cross-Platform Lightweight 2D Tank Multiplayer Game in Python 2/3☆10Oct 24, 2020Updated 5 years ago
- hadoop-3.1.2z在win10上编译的winUtils☆10Jun 24, 2019Updated 6 years ago
- 李述铜老师的操作系统课☆12Aug 13, 2023Updated 2 years ago
- # redis statefulset☆19Nov 13, 2019Updated 6 years ago
- UNIX like OS☆17Mar 7, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Angular directive for delaying child directives from rendering☆14Sep 14, 2014Updated 11 years ago
- SSM_CRUD（ssmcrud）,基于ssm+bootstrap的简单员工管理系统。SSM项目☆31Sep 12, 2025Updated 8 months ago
- Spark Streaming + kafka + hbase☆15Nov 19, 2018Updated 7 years ago
- xv7- (xv6+Demand Paging+Swapping)☆11Jul 19, 2020Updated 5 years ago
- B站视频演示代码☆13Mar 6, 2022Updated 4 years ago
- My Personal Blog☆13Updated this week
- 我的导航学习笔记，内容涵盖导航定位开源程序的源码解读 ( 包括：RTKLIB、GAMP、SoftGNSS、KF-GINS、ORB-SLAM3 等)、各种导航设备的使用方式、书籍讲义、博客翻译、开源项目梳理、常用网站记录、Linux/Vim/Git/ROS/VSCode 常用…☆16Mar 20, 2024Updated 2 years ago