yxlHuster/news-duplicated external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

yxlHuster/news-duplicated

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/yxlHuster/news-duplicated)

Close

yxlHuster / news-duplicatedView on GitHubMore

• External links
• Readme badge

文本去重算法，研究自推荐系统中新闻的去重，采用了雅虎的Near-duplicates and shingling算法，服务端用c实现，客户端用java实现，利用thrift框架进行通信，为了提高扩展性，去重可以在服务端实现，服务器也提供了计算的接口，方便客户端自己扩展

☆24Feb 25, 2014Updated 12 years ago

Alternatives and similar repositories for news-duplicated

Users that are interested in news-duplicated are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• Quincy1994 / MachineLearning

  View on GitHub
  ☆10May 2, 2017Updated 9 years ago
• GuohuaZhuang / deduplication-detecting

  View on GitHub
  文档去重功能是为了解决搜索引擎的文档语义重复的问题，方法是多重哈希下的语义指纹算法。
  ☆12Aug 17, 2013Updated 13 years ago
• yxlHuster / Sentiment

  View on GitHub
  情感分类
  ☆24Feb 23, 2014Updated 12 years ago
• snowlixue / wanfangPaperSystem

  View on GitHub
  一款对万方论文条目进行智能推荐和生成关键词故事线的系统
  ☆11Jun 24, 2018Updated 8 years ago
• ycloudnet / ya100

  View on GitHub
  一个比Spark-Parquet还快5~100倍的存储格式
  ☆12Feb 22, 2016Updated 10 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• smallbaby / hql-parser

  View on GitHub
  hive sql parser
  ☆11Aug 27, 2014Updated 12 years ago
• chenzhenyang / aquila

  View on GitHub
  迁移工具，目标是Oracle，MySQL，SqlServer到PostgreSQL的单项迁移，PostgreSQL和大数据平台Hive，Hbase，Impala等的双向迁移。
  ☆10Dec 3, 2014Updated 11 years ago
• itiki / PythonTo-repeat-the-text-Bigdata

  View on GitHub
  Python脚本实现千万级文本数据快速去重
  ☆19Mar 14, 2016Updated 10 years ago
• CSharpYDS / edge-computing-Q-learning

  View on GitHub
  Q learning and DQN
  ☆10Mar 14, 2022Updated 4 years ago
• duoan / codes-scratch-akka

  View on GitHub
  akka学习理解，使用了maven、sbt两种构建方式，同时使用量java和scala两种语言实现。akka入门，清晰理解akka流程
  ☆13Oct 18, 2015Updated 11 years ago
• dk-stationery / stationery-ink

  View on GitHub
  Distributed SQL base Realtime Streaming Computation Framework On Apache Storm, Spark
  ☆12Mar 14, 2016Updated 10 years ago
• luons / query-engine

  View on GitHub
  多数据源统一查询引擎
  ☆17Mar 11, 2022Updated 4 years ago
• QilinGu / Rnews

  View on GitHub
  简单的基于新闻语料的推荐算法实现
  ☆23Dec 16, 2016Updated 9 years ago
• BigPeng / FPtree

  View on GitHub
  FPtree algorithm to mining frequent pattern
  ☆20Aug 6, 2013Updated 13 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• weizxfree / KVisualRAG

  View on GitHub
  ☆16May 27, 2025Updated last year
• alex840906 / py_edge-computing_PSO

  View on GitHub
  ☆11Jul 1, 2019Updated 7 years ago
• fjiangAI / Word2Vec

  View on GitHub
  这是对word2vec的一些改进和应用。
  ☆13May 18, 2017Updated 9 years ago
• qianshangding / fish-flume

  View on GitHub
  flume扩展
  ☆14Nov 10, 2015Updated 10 years ago
• rees46 / rnn_recommendations

  View on GitHub
  Session-based Recommendations with Recurrent Neural Networks
  ☆14Dec 14, 2017Updated 8 years ago
• ziapple / DBExchange

  View on GitHub
  基于ActiveMQ的数据交换中间件
  ☆14Aug 17, 2014Updated 12 years ago
• w4ngzhen / intellij-jcef-plugin

  View on GitHub
  ☆12Oct 12, 2021Updated 5 years ago
• hxun123 / spring-boot-demo

  View on GitHub
  spring boot 相关使用代码
  ☆11May 26, 2018Updated 8 years ago
• Grox888 / Mobile_Edge_Computing

  View on GitHub
  DRL or Heuristic algorithms for MEC system
  ☆14Apr 9, 2024Updated 2 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• tanzhuqing / b5m-web-adrsclick

  View on GitHub
  广告推荐系统
  ☆21Aug 12, 2014Updated 12 years ago
• skyobin / logwaf

  View on GitHub
  基于nginx lua做前端防御，基于hadoop做用户行为分析的waf
  ☆11Nov 17, 2016Updated 9 years ago
• stalary / lightMQ

  View on GitHub
  由java构建的轻量级消息队列，支持订阅和点对点模式
  ☆34Mar 18, 2019Updated 7 years ago
• qzw1210 / geeco

  View on GitHub
  Gecco是一款用java语言开发的轻量化的易用的网络爬虫。Gecco整合了jsoup、httpclient、fastjson、spring、htmlunit、redission等优秀框架，让您只需要配置一些jquery风格的选择器就能很快的写出一个爬虫。Gecco框架有优…
  ☆12Mar 9, 2017Updated 9 years ago
• qumingxing / framework-nio

  View on GitHub
  基于JAVA NIO 的轻量级消息传输框架。主要功能包括：文本消息传输、二进制文件传输、文本及二进制混合传输、消息的自定义实现加密传输算法、同步或异步传输、客户端、服务端框架内置心跳监听、服务端认证、支持网络断线客户端自动重连。
  ☆43May 12, 2017Updated 9 years ago
• NanGePlus / PydanticAITest

  View on GitHub
  PydanticAI开源框架，搭建基于PostgreSQL、MySQL的Text2SQL应用进行SQL语句生成，支持GPT大模型、国产大模型、开源本地大模型
  ☆18Dec 26, 2024Updated last year
• WHUIR / RAGE

  View on GitHub
  The Tensorflow implementation of "Review-driven Answer Generation for Product-related Questions in E-commerce ", WSDM 2019.
  ☆23Nov 5, 2022Updated 3 years ago
• awnuxkjy / recommend-system

  View on GitHub
  recommend system study
  ☆66Oct 27, 2013Updated 12 years ago
• dgyuanjun / SpringBoot-Vue

  View on GitHub
  SpringBoot整合Vue，实现前后端的分离。采用SSM框架，实现服务器端的java代码实现
  ☆19Mar 13, 2018Updated 8 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• 3kuai / hanbo-db

  View on GitHub
  hanboDB is a high available,low latency memory database system
  ☆39Apr 4, 2023Updated 3 years ago
• drogba321 / easy-recommender

  View on GitHub
  个性化推荐算法的通用处理框架，基于Mahout和Lucene
  ☆18May 25, 2015Updated 11 years ago
• ljcan / Java_Review

  View on GitHub
  该项目持续更新，整理保存相关学习笔记（包括数据结构、操作系统、计算机网络、数据库、JAVA、Scala、后端、SQL&NOSQL、大数据、数据挖掘等方面知识）
  ☆14Mar 4, 2021Updated 5 years ago
• jinxqy / h5-nav

  View on GitHub
  h5端调起高德、腾讯、百度地图实现车载导航插件封装
  ☆10Dec 10, 2022Updated 3 years ago
• tapdata / idaas-pdk

  View on GitHub
  ☆39Jun 27, 2022Updated 4 years ago
• GongDexing / database-sync

  View on GitHub
  基于java开发，功能强大、配置灵活的数据库之间同步工具，可以执行多个数据同步任务，并且可以根据cron表达式配置同步的周期和时间
  ☆46Jul 17, 2016Updated 10 years ago
• milinda / samza-sql

  View on GitHub
  SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka
  ☆30Jun 8, 2016Updated 10 years ago