NikhilDhiman / SQOOP-AutomationLinks
A shell script to automate the operations of sqoop
☆11Updated 4 years ago
Alternatives and similar repositories for SQOOP-Automation
Users that are interested in SQOOP-Automation are comparing it to the libraries listed below
Sorting:
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Updated 2 years ago
- Showcasing Online analytical processing with Apache Kylin☆8Updated 7 years ago
- Spark1.6和spark2.2的示例,包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe☆15Updated 7 years ago
- 基于 spark 混合查询平台,支持不同源数据库的联合查询,mysql hive presto ...☆14Updated 7 years ago
- Livy REST API封装,批处理模式☆19Updated 6 years ago
- Project for reading data from kafka and writing to kafka and HBase with kerberos☆24Updated 8 years ago
- ☆14Updated 8 years ago
- SparkSQL数据分析案例☆23Updated 8 years ago
- better performance for kylin query☆15Updated 6 years ago
- Project to create configurable ETL via lightbend configuration using Spark Structured Streaming☆8Updated 7 years ago
- 使用spark对hive、hbase、ES的读写, 实现一次配置可对不同数据库进行导入导出,并对ES、hbase进行封装☆33Updated 8 years ago
- 用户画像代码,根据算法推算出用户的性别和年龄比率☆11Updated 7 years ago
- A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0☆25Updated 3 years ago
- 对HBase API的简单封装,Java和Scala混编☆8Updated 8 years ago
- The Best Practice of HDP,企业级大数据平台实践指南☆10Updated 7 years ago
- 因现有的datax、sqoop满足不了需求,使用spark封装了一个数据同步工具。☆9Updated 6 years ago
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Updated last year
- Spark structured-streaming 消费kafka数据写入hbase☆33Updated 6 years ago
- 易观开源大数据互联网百亿级记录互传Backquarter项目☆19Updated 3 years ago
- ETL pipeline using pyspark (Spark - Python)☆117Updated 5 years ago
- 基于Spark SQL,可通过输入SQL语句操作HBase表,目前提 供对HBase表的查询、创建、删除以及数据插入(需要自己指定rowKey生成规则)的功能,数据删除,分布式导入大规模数据相关功能正在开发中☆13Updated 9 months ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Updated 9 years ago
- Spark Streaming HBase Example☆96Updated 9 years ago
- Spark Streaming HBase Example☆22Updated 9 years ago
- A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).☆14Updated last year
- Flink Sql 教程☆34Updated 6 months ago
- This repo is mostly created for pyspark and hive related interview questions.☆47Updated 3 years ago
- 一个为spark批量导入数据到hbase的库☆43Updated 8 years ago