taoran92/HadoopDedup external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

taoran92/HadoopDedup

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/taoran92/HadoopDedup)

Close

taoran92 / HadoopDedupView on GitHubMore

• External links
• Readme badge

基于Hadoop和HBase的大规模海量数据去重

☆30Apr 8, 2018Updated 8 years ago

Alternatives and similar repositories for HadoopDedup

Users that are interested in HadoopDedup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• IvanFernandez / hbase-spark-playground

  View on GitHub
  A basic java word count for spark
  ☆15Jan 8, 2015Updated 11 years ago
• itiki / PythonTo-repeat-the-text-Bigdata

  View on GitHub
  Python脚本实现千万级文本数据快速去重
  ☆19Mar 14, 2016Updated 10 years ago
• fengruotj / BigDataAnalysisWeb

  View on GitHub
  Big data performance test analysis platform (including WebUI display)。 BigDataAnalysisWeb Analyze storm, spark, and flink throughput chan…
  ☆20May 17, 2019Updated 7 years ago
• tygxy / StreamingDemo

  View on GitHub
  Spark Streaming + kafka + hbase
  ☆15Nov 19, 2018Updated 7 years ago
• anowls / spring-hadoop

  View on GitHub
  大数据实习hdfs+flume+kafka+spark+hbase+hive项目
  ☆35Jul 25, 2017Updated 8 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• windwant / bigdata-service

  View on GitHub
  hadoop flume hbase kafka storm；读取kafka数据=》storm实时处理（分割字符，统计字符）=》写入hdfs
  ☆21Sep 21, 2018Updated 7 years ago
• zunzhuowei / qs-hadoop

  View on GitHub
  大数据生态圈学习
  ☆18Oct 5, 2022Updated 3 years ago
• Maskvvv / easy-flink-cdc

  View on GitHub
  一个基于 Flink CDC 的 CDC 框架，mysql，binlog
  ☆12Jun 1, 2026Updated last month
• jialiuyang / appBack

  View on GitHub
  这是一个封装好的app后台框架，欢迎大家修改指正。This is a good package app background framework, welcome to amend the... هذا هو  التعبئة والتغليف جيدة  التطبيق …
  ☆10Mar 31, 2016Updated 10 years ago
• AdoptOpenJDK / openjdk-jdk8u-backup

  View on GitHub
  OpenJDK jdk8u source mirror on master, with selective patches on branch 'dev'.
  ☆16Feb 15, 2018Updated 8 years ago
• wzjgn / zktd-bigdata-platform

  View on GitHub
  基于springcloud + token + redis + mongodb 的微服务平台
  ☆42Dec 11, 2018Updated 7 years ago
• flowers2023 / spark-streaming

  View on GitHub
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Sep 16, 2015Updated 10 years ago
• apache / plc4x-build-tools

  View on GitHub
  Apache plc4x Build Tools
  ☆19May 19, 2026Updated last month
• hjguang / spring-cloud

  View on GitHub
  ☆11Jan 3, 2024Updated 2 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• lovisdotio / fal-wan26-video-factory

  View on GitHub
  Chain MiniMax Speech + Nano Banana Pro + Wan 2.6 to generate videos from script segments. Built for the official Wan 2.6 release with fal…
  ☆28Dec 19, 2025Updated 6 months ago
• yangtairen / spring-geomesa

  View on GitHub
  springboot-geomesa-hbase
  ☆11Dec 29, 2018Updated 7 years ago
• CCChenhao997 / CCL2020-Humor-Computation

  View on GitHub
  CCL2020 第二届“小牛杯”幽默计算——情景喜剧笑点识别
  ☆13Sep 29, 2020Updated 5 years ago
• Allyns / AllynWebView

  View on GitHub
  webview实践总结Demo
  ☆12Jan 7, 2019Updated 7 years ago
• pzone618 / OpenSource

  View on GitHub
  ☆10Mar 11, 2024Updated 2 years ago
• Daedelus1982 / AutoLeveller

  View on GitHub
  Processes a GCode file to add a probing stage and uses that probing stage to automatically adjust the Z axis. Can be used to produce bett…
  ☆15Jan 10, 2014Updated 12 years ago
• analogdevicesinc / iolink

  View on GitHub
  ☆17Mar 26, 2026Updated 3 months ago
• TuRanLisp / ZicroBrowser

  View on GitHub
  开源浏览器
  ☆11Aug 13, 2013Updated 12 years ago
• ameyamk / spark-streaming-direct-kafka

  View on GitHub
  High Performance Spark Streaming with Direct Kafka in Java
  ☆39Sep 14, 2016Updated 9 years ago
• GPUs on demand by Runpod - Special Offer Available • Ad
  Run AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
• longshilin / wgs

  View on GitHub
  WGS Sequencing In Hadoop MapReduce
  ☆15Oct 13, 2020Updated 5 years ago
• yashbonde / transformer_network_tensorflow

  View on GitHub
  Tensorflow implementation of transformer network from "Attention is all you need" Paper. Also use cases of it!
  ☆16Jan 23, 2020Updated 6 years ago
• percent4 / Docker_env_test

  View on GitHub
  该项目用于演示如何构建Python开发环境的Docker镜像，并使用PyCharm连接Docker镜像进行开发测试。
  ☆12Dec 25, 2019Updated 6 years ago
• zilliz-bootcamp / image_search_v2

  View on GitHub
  ☆17Aug 10, 2021Updated 4 years ago
• Glyphoid / math-handwriting-lib

  View on GitHub
  Java library for parsing and evaluating handwritten mathematical formulae
  ☆11Dec 28, 2016Updated 9 years ago
• reallin / Bayes

  View on GitHub
  用java实现的贝叶斯分类算法。用于大数据的分类。
  ☆43Nov 24, 2015Updated 10 years ago
• HY-ZhengWei / HBaseClient

  View on GitHub
  HBase客户端数据管理软件
  ☆161Nov 15, 2018Updated 7 years ago
• xmlking / cdc-kafka-hadoop

  View on GitHub
  MySQL to NoSQL real time dataflow
  ☆19Oct 14, 2017Updated 8 years ago
• QuanLab / node2vec-spark

  View on GitHub
  Implement node2vec algorithm using Spark 2 from: http://snap.stanford.edu/node2vec/
  ☆11Jul 10, 2019Updated 6 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• tladesignz / ShadowSocks-libev-iOS

  View on GitHub
  ☆10Feb 27, 2018Updated 8 years ago
• ros-industrial-attic / crcl

  View on GitHub
  ☆12Mar 16, 2022Updated 4 years ago
• bushuhui / machinelearning_notebook

  View on GitHub
  Notebooks for machine learning
  ☆15Mar 20, 2026Updated 3 months ago
• rilyu / mdm-server

  View on GitHub
  Sample iOS MDM server
  ☆11Apr 5, 2016Updated 10 years ago
• daliasheasha / HelloWorldDocker

  View on GitHub
  A simple Hello World application that runs on Docker.
  ☆16Jan 24, 2023Updated 3 years ago
• cristinalombardo / opc-server-spring

  View on GitHub
  Implementation of OPC Server using Eclipse Milo Into Spring Boot
  ☆11Sep 15, 2022Updated 3 years ago
• langzhigang / activemq-springboot-demo

  View on GitHub
  activemq activemq-springboot demo
  ☆12Dec 24, 2016Updated 9 years ago