基于Scrapy-Redis框架与Mongodb的分布式爬虫-elasticsearch搜索引擎打造
☆18Apr 21, 2020Updated 6 years ago
Alternatives and similar repositories for Scrapy_spider
Users that are interested in Scrapy_spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Crawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: i…☆40Aug 23, 2018Updated 7 years ago
- 项目整体分为scrapy-redis分布式爬虫爬取数据、基于ElasticSearch数据检索和前端界面展示三大模块。做此项目是为了熟悉scrapy-redis的基本流程，以及其背后的原理，同时熟悉ElasticSearch的使用。本项目可以作为一个基于ES存储的简单但是相…☆25Dec 8, 2022Updated 3 years ago
- 慕课网-Python Flask构建可扩展的RESTful API-笔记☆13Jun 16, 2018Updated 7 years ago
- 实现功能：新输入一段文本，与已有数据进行相似度进行比较，返回TOP10的文本。主要实现方法：jieba中文分词、gensim、TF-IDF词汇重要性、cosine余弦相似度。☆11Jul 30, 2020Updated 5 years ago
- ☆12May 3, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 本项目包含几种常用 NLP算法的实现：关键词(keyword)、命名实体(named entity)、自动摘要(abstract)、文本相似度比较(text similarity)等☆16Jan 16, 2022Updated 4 years ago
- All the useful tools I have been using while working in data science for remote sensing☆11Nov 27, 2019Updated 6 years ago
- Scrapy框架,抓取商品信息(已爬70w+数据)☆21Aug 31, 2018Updated 7 years ago
- 【Demo】对新闻标题使用TF-IDF向量化和cosine相似度计算完成相似标题推荐☆14Mar 2, 2020Updated 6 years ago
- 基于simhash的文本去重算法☆20Jun 18, 2021Updated 4 years ago
- pinduoduo_spider☆22Feb 28, 2019Updated 7 years ago
- 批量下载抖音用户视频☆20Jan 19, 2024Updated 2 years ago
- ☆21Jan 9, 2023Updated 3 years ago
- 长文本相似度模型☆21Nov 24, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The DSDT and SSDTs of Lenovo G470 for hackintosh.☆12Dec 23, 2017Updated 8 years ago
- flutter写的一个影视APP☆26Jan 10, 2021Updated 5 years ago
- cloudwu/skynet in .NET☆22Oct 1, 2025Updated 7 months ago
- # redis statefulset☆19Nov 13, 2019Updated 6 years ago
- Official repository for the paper "Gradient-based Jailbreak Images for Multimodal Fusion Models" (https//arxiv.org/abs/2410.03489)☆19Oct 22, 2024Updated last year
- Project 5 during the Metis Data Science Program - Pricing Tool for Airbnb Hosts☆21Jun 17, 2024Updated last year
- 博客转md格式保存至本地(Save the blog in md format locally)☆24Dec 28, 2020Updated 5 years ago
- ☆14Oct 14, 2024Updated last year
- 面向证券信息类专业搜索引擎，基于WEB信息挖掘技术的专业搜索引擎设计与实现并着重分析基于特定主题的爬取方法，通过下载Internet上WEB文档，进行过滤、分词、转换等处理工作，并建立索引数据库，最终可由检索器通过用户输入查询关键字，搜索器支持微博客、短信等内容短小而又不规…☆24Dec 3, 2018Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- HanLP: Han Language Processing , Java version☆30Oct 13, 2020Updated 5 years ago
- ☆17Nov 15, 2021Updated 4 years ago
- ElasticSearch+Django+Scrapy搜索引擎☆28Dec 8, 2022Updated 3 years ago
- Google Earth Engine Automated Annual Mapping of Irrigated Lands☆12Dec 18, 2025Updated 4 months ago
- Pandas style guide and best practices. Opinionated guide on how to write Pandas code which is more consistent, reliable, maintainable and…☆15Mar 8, 2021Updated 5 years ago
- RESTful Web API bridge for Google Earth Engine calculations☆10Jan 6, 2019Updated 7 years ago
- XXE - VULNSPY PHP AUDIT☆18Oct 15, 2018Updated 7 years ago
- This is a chrome extension for my blog to get updated on the latest blogs.☆14Aug 8, 2024Updated last year
- 支持多服务端的Frp Openwrt插件☆20Mar 6, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Spring Cloud 与 Docker 整合使用示例，为《使用Spring Cloud与Docker实战微服务》的配套代码。书籍地址：https://github.com/eacdy/spring-cloud-book 。讨论QQ群：157525002（已满）、5648…☆41Oct 15, 2016Updated 9 years ago
- Standardized query interface for searching geospatial assets via STAC.☆19Mar 25, 2021Updated 5 years ago
- ☆16Jul 21, 2016Updated 9 years ago
- 用于深度学习领域图片识别项目的验证码样本数据生成器☆34May 22, 2018Updated 7 years ago
- DoubanFlimSpider☆36Sep 2, 2021Updated 4 years ago
- AI 协作开发框架模板 - Claude Code 工具库 + 8 阶段工作流 + 标准化文档模板☆54Jan 12, 2026Updated 3 months ago
- 大数据组件学习；包括dataflow，spring cloud stream；elasticsearch；flink；spark；kafka；phoenix；Hive；Hbase；☆22Jul 1, 2022Updated 3 years ago