基于Scrapy-Redis框架与Mongodb的分布式爬虫-elasticsearch搜索引擎打造
☆17Apr 21, 2020Updated 6 years ago
Alternatives and similar repositories for Scrapy_spider
Users that are interested in Scrapy_spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Crawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: i…☆40Aug 23, 2018Updated 8 years ago
- 项目整体分为scrapy-redis分布式爬虫爬取数据、基于ElasticSearch数据检索和前端界面展示三大模块。做此项目是为了熟悉scrapy-redis的基本流程，以及其背后的原理，同时熟悉ElasticSearch的使用。本项目可以作为一个基于ES存储的简单但是相…☆24Dec 8, 2022Updated 3 years ago
- 基于redis-stream的延迟队列☆14Oct 24, 2022Updated 3 years ago
- 基于spring-security的微服务鉴权中心☆13Nov 9, 2022Updated 3 years ago
- 基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】☆13Feb 29, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Springboot + ElasticSearch 构建博客检索系统☆12Mar 5, 2020Updated 6 years ago
- 基于Python3实现的js加密反爬，验证码破解，字体加密反爬等其他类型反爬虫的破解☆15Jun 9, 2023Updated 3 years ago
- 猫眼电影评论爬虫，给出猫眼电影id即可。☆14Dec 19, 2019Updated 6 years ago
- 实现功能：新输入一段文本，与已有数据进行相似度进行比较，返回TOP10的文本。主要实现方法：jieba中文分词、gensim、TF-IDF词汇重要性、cosine余弦相似度。☆11Jul 30, 2020Updated 6 years ago
- 本项目包含几种 常用 NLP算法的实现：关键词(keyword)、命名实体(named entity)、自动摘要(abstract)、文本相似度比较(text similarity)等☆16Jan 16, 2022Updated 4 years ago
- Performing Latent Semantic Analysis with Python on large datasets.☆13Jun 21, 2022Updated 4 years ago
- Scrapy框架,抓取商品信息(已爬70w+数据)☆21Aug 31, 2018Updated 8 years ago
- 【Demo】对新闻标题使用TF-IDF向量化和cosine相似度计算完成相似标题推荐☆14Mar 2, 2020Updated 6 years ago
- 基于simhash的文本去重算法☆20Jun 18, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 京东爬虫 和 评论清洗及指标提取☆24May 13, 2015Updated 11 years ago
- 长文本相似度模型☆21Nov 24, 2023Updated 2 years ago
- The DSDT and SSDTs of Lenovo G470 for hackintosh.☆12Dec 23, 2017Updated 8 years ago
- hadoop-3.1.2z在win10上编译的winUtils☆10Jun 24, 2019Updated 7 years ago
- 面向证券信息类专业搜索引擎，基于WEB信息挖掘技术的专业搜索引擎设计与实现并着重分析基于特定主题的爬取方法，通过下载Internet上WEB文档，进行过滤、分词、转换等处理工作，并建立索引数据库，最终可由检索器通过用户输入查询关键字，搜索器支持微博客、短信等内容短小而又不规…☆25Dec 3, 2018Updated 7 years ago
- # redis statefulset☆19Nov 13, 2019Updated 6 years ago
- Data-enriching GAN for retrieving Representative Samples from aTrained Classifier☆14Sep 2, 2020Updated 6 years ago
- 手把手教你ShardingSphere入门☆15Nov 13, 2020Updated 5 years ago
- 湖湘传统技艺类非物质文化遗产数字化与虚拟体验平台☆26Nov 3, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- 一个基于SSM框架+Layuimini前端模板开发的酒店管理系统☆20May 10, 2021Updated 5 years ago
- A list of interesting payloads, tips and tricks for bug bounty hunters.☆25Sep 1, 2019Updated 7 years ago
- TF-IDF+Word2vec做文本相似度计算，最好是长文本☆24Dec 18, 2019Updated 6 years ago
- HanLP: Han Language Processing , Java version☆30Oct 13, 2020Updated 5 years ago
- Source code for our AAAI 2020 paper P-SIF: Document Embeddings using Partition Averaging☆35May 2, 2020Updated 6 years ago
- ElasticSearch+Django+Scrapy搜索引擎☆28Dec 8, 2022Updated 3 years ago
- BiC-Net: Learning Efficient Spatio-Temporal Relation for Text-Video Retrieval☆28Jul 22, 2022Updated 4 years ago
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆18Apr 15, 2025Updated last year
- 支持多服务端的Frp Openwrt插件☆20Mar 6, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Spring Cloud 与 Docker 整合使用示例，为《使用Spring Cloud与Docker实战微服务》的配套代码。书籍地址：https://github.com/eacdy/spring-cloud-book 。讨论QQ群：157525002（已满）、5648…☆41Oct 15, 2016Updated 9 years ago
- USER: Unified Semantic Enhancement with Momentum Contrast for Image-Text Retrieval, TIP 2024☆33Jun 18, 2025Updated last year
- HTML5 rich text editor. Try the demo integration at☆20Jun 19, 2019Updated 7 years ago
- 螺丝帽点击验证码破解sdk,仅供学习，若擅自使用本人不承担任何责任☆29Jun 29, 2019Updated 7 years ago
- DoubanFlimSpider☆36Sep 2, 2021Updated 5 years ago
- a new Chinese Weibo comments dataset collected from Sina Weibo comment specifically for cyberbullying detection☆17Aug 29, 2019Updated 7 years ago
- Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles☆20Jul 26, 2023Updated 3 years ago