文本去重算法，研究自推荐系统中新闻的去重，采用了雅虎的Near-duplicates and shingling算法，服务端用c实现，客户端用java实现，利用thrift框架进行通信，为了提高扩展性，去重可以在服务端实现，服务器也提供了计算的接口，方便客户端自己扩展
☆24Feb 25, 2014Updated 12 years ago
Alternatives and similar repositories for news-duplicated
Users that are interested in news-duplicated are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10May 2, 2017Updated 9 years ago
- hadoop中Map/Reduce使用示例，输入(DBInputFormat),输出(DBOutputFormat)为MySql数据库表、日志分析Grep、单词排序Sort...对HBase的基本操作，增、删、查、改，使用Map/Reduce批量导入数据到HBase表中..…☆14Apr 6, 2013Updated 13 years ago
- 文档去重功能是为了解决搜索引擎的文档语义重复的问题，方法是多重哈希下的语义指纹算法。☆12Aug 17, 2013Updated 13 years ago
- 一款对万方论文条目进行智能推荐和生成关键词故事线的系统☆11Jun 24, 2018Updated 8 years ago
- 情感分类☆24Feb 23, 2014Updated 12 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- hive sql parser☆11Aug 27, 2014Updated 12 years ago
- 迁移工具，目标是Oracle，MySQL，SqlServer到PostgreSQL的单项迁移，PostgreSQL和大数据平台Hive，Hbase，Impala等的双向迁移。☆10Dec 3, 2014Updated 11 years ago
- Python脚本实现千万级文本数据快速去重☆19Mar 14, 2016Updated 10 years ago
- 化验单ocr识别，目的识别出化验项目词条、结果数值及其定位☆10Mar 12, 2022Updated 4 years ago
- 一个比Spark-Parquet还快5~100倍的存储格式☆12Feb 22, 2016Updated 10 years ago
- 今日头条as，cp，signature算法，获取热点新闻、用户文章（正文、评论）☆11Aug 13, 2019Updated 7 years ago
- Distributed SQL base Realtime Streaming Computation Framework On Apache Storm, Spark☆12Mar 14, 2016Updated 10 years ago
- akka学习理解，使用了maven、sbt两种构建方式，同时使用量java和scala两种语言实现。akka入门，清晰理解akka流程☆13Oct 18, 2015Updated 11 years ago
- Lucene learning.☆14Jun 11, 2014Updated 12 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- FPtree algorithm to mining frequent pattern☆20Aug 6, 2013Updated 13 years ago
- 新闻推荐系统☆10Aug 14, 2019Updated 7 years ago
- 📚 A Go port for caj2pdf/caj2pdf☆10Feb 23, 2023Updated 3 years ago
- 一个基于朴素贝叶斯算法的新闻文本分类器☆13Jan 12, 2018Updated 8 years ago
- 基于ActiveMQ的数据交换中间件☆14Aug 17, 2014Updated 12 years ago
- A Tensorflow version of Yoon Kim's char-cnn-lstm☆10May 5, 2017Updated 9 years ago
- Session-based Recommendations with Recurrent Neural Networks☆14Dec 14, 2017Updated 8 years ago
- DRL or Heuristic algorithms for MEC system☆14Apr 9, 2024Updated 2 years ago
- 以中国新闻网社会新闻板块为抓取对象,通过关键词来分析新闻热点事件☆18Mar 8, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MySQL to NoSQL real time dataflow☆19Oct 14, 2017Updated 9 years ago
- 个性化推荐算法的通用处理框架，基于Mahout和Lucene☆18May 25, 2015Updated 11 years ago
- ☆12Oct 12, 2021Updated 5 years ago
- 由java构建的轻量级消息队列，支持订阅和点对点模式☆34Mar 18, 2019Updated 7 years ago
- 换脸制作学士服毕业照☆11Mar 7, 2021Updated 5 years ago
- 基于nginx lua做前端防御，基于hadoop做用户行为分析的waf☆11Nov 17, 2016Updated 9 years ago
- ☆10Dec 6, 2017Updated 8 years ago
- 长沙理工大学硕博学位论文 LaTeX 模板☆19Mar 4, 2024Updated 2 years ago
- sql转换器，基于druid sql parser 完成动态的sql转换功能☆12Aug 6, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 基于ssm的新闻管理系统：前端 jsp、jquery，后端 springmvc、spring、mybatis；角色分为管理员、用户；集成财经新闻，汽车新闻，体育新闻，后台发布新闻等功能于一体的系统。☆25Jan 30, 2025Updated last year
- recommend system study☆65Oct 27, 2013Updated 13 years ago
- ☆16May 27, 2025Updated last year
- PydanticAI开源框架，搭建基于PostgreSQL、MySQL的Text2SQL应用进行SQL语句生成，支持GPT大模型、国产大模型、开源本地大模型☆18Dec 26, 2024Updated last year
- Client for TensorFlow Serving☆14Mar 27, 2018Updated 8 years ago
- cdn 解决最优网络流传输分配的服务器选点问题☆11Nov 11, 2018Updated 7 years ago
- 工具助手☆14Oct 14, 2019Updated 7 years ago