项目整体分为scrapy-redis分布式爬虫爬取数据、基于ElasticSearch数据检索和前端界面展示三大模块。做此项目是为了熟悉scrapy-redis的基本流程，以及其背后的原理，同时熟悉ElasticSearch的使用。本项目可以作为一个基于ES存储的简单但是相对全面的全栈开发的Demo。项目中所采用的组件均在win10本地环境搭建（伪分布），旨在演示项目流程。你可以参考该项目，并将其扩展到多个主机上，实现分布式ES以及分布式Scrapy。
☆25Dec 8, 2022Updated 3 years ago
Alternatives and similar repositories for JobNews-ElasticSearch-Scrapy_redis
Users that are interested in JobNews-ElasticSearch-Scrapy_redis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- elasticsearch实现增强百科搜索，scrapy实现百科爬虫，项目通过Django呈现web☆14Nov 26, 2020Updated 5 years ago
- Mathematics Association of Nairobi University [MANU]☆14Aug 7, 2023Updated 2 years ago
- 基于Scrapy+Elasticsearch+Django搭建的分布式电影搜索☆31Jul 25, 2018Updated 7 years ago
- 🕷️ [Graduation Project] Scrapy-Redis distributed crawler + Elasticsearch search engine + Django full-stack application; 论文搜索引擎（含Scrapy-R…☆44Feb 18, 2023Updated 3 years ago
- ElasticSearch+Django+Scrapy搜索引擎☆28Dec 8, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 基于Scrapy-Redis框架与Mongodb的分布式爬虫-elasticsearch搜索引擎打造☆18Apr 21, 2020Updated 5 years ago
- A SwiftUI application to modify static routes on macOS☆20Mar 24, 2026Updated 2 weeks ago
- python搭建搜索引擎☆30May 5, 2022Updated 3 years ago
- 通过django将scrapy爬取存储到mongodb的数据展示到web页面，增删改查等功能☆13Aug 16, 2018Updated 7 years ago
- scrapy抓取，mysql储存，django展示☆12Feb 6, 2016Updated 10 years ago
- 南开大学操作系统课程实验（UCore）☆11Oct 16, 2022Updated 3 years ago
- Unity 结合AIGC 虚拟仿真人项目☆11Feb 21, 2025Updated last year
- ☆10Sep 7, 2022Updated 3 years ago
- 基于Dear -imgui 的软光栅化渲染器 （学习项目）☆10Feb 21, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】☆13Feb 29, 2024Updated 2 years ago
- 1. 本项目模块化鲜明、代码简洁、功能小巧、配置灵活，是一个易于上手进行二次开发和快速构建企业内部统一用户认证中心服务的组件。 2. 本项目对服务端session的缓存提供了多种实现方式，如redis的实现方式就多达4种，可基于灵活的配置适配redis的各种部署方式。 3.…☆21Aug 24, 2023Updated 2 years ago
- Springboot + ElasticSearch 构建博客检索系统☆12Mar 5, 2020Updated 6 years ago
- Scrapy, tianya, 天涯; scrapy django增量抓取天涯莲蓬鬼话全部帖子☆21Mar 20, 2025Updated last year
- 实现功能：新输入一段文本，与已有数据进行相似度进行比较，返回TOP10的文本。主要实现方法：jieba中文分词、gensim、TF-IDF词汇重要性、cosine余弦相似度。☆11Jul 30, 2020Updated 5 years ago
- Enable to share the same TCP port for different applications, for example, http and ssh.☆11Oct 2, 2020Updated 5 years ago
- 史上最全编程语言xmind思维导图总结 包含python/php/flask/爬虫/javascript/mysql/nosql/git☆24Jun 29, 2021Updated 4 years ago
- 本项目包含几种常用 NLP算法的实现：关键词(keyword)、命名实体(named entity)、自动摘要(abstract)、文本相似度比较(text similarity)等☆16Jan 16, 2022Updated 4 years ago
- Performing Latent Semantic Analysis with Python on large datasets.☆13Jun 21, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 2023年南开大学操作系统课程实验指北（助教小木个人版）☆17Nov 1, 2023Updated 2 years ago
- this project use dlib & opencv, can swap face or head☆11Dec 26, 2017Updated 8 years ago
- 租房网站信息分析项目（Vue+Django+Scrapy）☆26Jun 19, 2020Updated 5 years ago
- 静态站 用vue-element-admin框架搭建☆12Dec 4, 2018Updated 7 years ago
- 网站监控☆11Nov 9, 2019Updated 6 years ago
- some example plots that are maybe useful?☆11Feb 10, 2026Updated last month
- 主要使用python+Scrapy框架去抓取新闻网站☆25Mar 2, 2017Updated 9 years ago
- ☆21Jan 9, 2023Updated 3 years ago
- MySQL storage for OAuth 2.0☆13Mar 13, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- 8 bit CPU implemented on top of a Digital Circuit Simulator in TypeScript☆12May 15, 2025Updated 10 months ago
- Python大作业虚假新闻检测☆26Jan 4, 2025Updated last year
- 国家税务总局全国增值税发票查验平台☆15Dec 16, 2020Updated 5 years ago
- The DSDT and SSDTs of Lenovo G470 for hackintosh.☆12Dec 23, 2017Updated 8 years ago
- feapder的管道扩展☆16Mar 6, 2023Updated 3 years ago
- 一个基于分布式爬虫的信安文章搜索引擎☆27May 22, 2023Updated 2 years ago
- Windows MediaPlayer Engine☆12Sep 12, 2020Updated 5 years ago