code-dm / mriyaLinks
Real-time ETL developed by Flink, data from MySQL to Greenplum. Use canal to parse the MySQL binlog, put it into kafka, use Flink to consume kafka and assemble the data into Greenplum, and more data sources and target sources will be added in the future.
☆80Updated last year
Alternatives and similar repositories for mriya
Users that are interested in mriya are comparing it to the libraries listed below
Sorting:
- flink sql connector clickhouse zeppelin☆79Updated 3 years ago
- flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0☆111Updated 3 years ago
- 基于 Flink 的 sqlSubmit 程序☆145Updated last year
- Using Flink SQL to build ETL job☆203Updated last year
- 给flink开发的web系统。支持页面上定义udf,进行sql和jar任务的提交;支持source、sink、job的管理;可以管理openshift上的flink集群☆284Updated 2 years ago
- DorisDB SQL解析器Java实现;Clickhouse SQL解析器Java实现☆96Updated 3 years ago
- 通过语法树解析获取字段级血缘数据☆61Updated 2 years ago
- 为DataX(https://github.com/alibaba/DataX) 提供远程多语言调用(ThriftServer,HttpServer) 分布式运行(DataX on YARN) 功能☆144Updated 3 weeks ago
- 数据血缘,Hive/Sqoop/HBase/Spark等,发送到kafka后,解析处理使用neo4j生成血缘☆82Updated 3 years ago
- Spark、Flink等离线任务的调度以及实时任务的监控☆303Updated last year
- Real time data processing system based on flink and CEP☆249Updated 7 months ago
- 基于flink1.9.1,flink-sql-client模块SDK单独实现,支持Yarn集群的远程SQL任务发布,可以支撑flink sql任务的远程化执行☆49Updated 2 years ago
- Make data connection easier☆22Updated 3 years ago
- Unified SQL Analytics Engine Based on SparkSQL☆211Updated 2 years ago
- ☆38Updated 2 years ago
- Doris表和字段血缘项目☆82Updated last year
- Platform for Flink☆281Updated 2 years ago
- 如果你在从事大数据BI的工作,想对比一下MySQL、GreenPlum、Elasticsearch、Hive、Spark SQL、Presto、Impala、Drill、HAWQ、Druid、Pinot、Kylin、ClickHouse、Kudu等不同实现方案之间的表现,…☆283Updated 7 years ago
- sql解析工具。主要解析hive sql、spark sql、presto sql。从sql中解析出输入表、输出表以及字段等信息☆96Updated 2 years ago
- 基于flink 1.8 源码二次开发,详见MD☆82Updated 5 years ago
- 基于Apache-bahir-kudu-connector的flink-connector-kudu,支持Flink1.11.x DynamicTableSource/Sink,支持Range分区等☆45Updated 2 years ago
- ☆118Updated 2 years ago
- Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-an…☆107Updated 3 months ago
- ☆130Updated 2 months ago
- 从本地IDEA提交Flink/Spark任务到Yarn/k8s集群☆164Updated 3 years ago
- presto hbase connector 组件基于Presto Connector接口规范实现,用来给Presto增加查询HBase的功能。相比其他开源版本的HBase Connector,我们的性能要快10到100倍以上。☆241Updated 2 years ago
- hive sql 字段血缘☆23Updated 3 years ago
- 汇总Apache Hudi中的一些Demo,便于快速上手Apache Hudi(Apache Hudi Demos to help beginners know about Hudi)☆75Updated 4 years ago
- Apache StreamPark quickstart☆73Updated 6 months ago
- kudu可视化工具☆38Updated 3 weeks ago