code-dm / mriya
Real-time ETL developed by Flink, data from MySQL to Greenplum. Use canal to parse the MySQL binlog, put it into kafka, use Flink to consume kafka and assemble the data into Greenplum, and more data sources and target sources will be added in the future.
☆78Updated 10 months ago
Alternatives and similar repositories for mriya:
Users that are interested in mriya are comparing it to the libraries listed below
- 数据血缘,Hive/Sqoop/HBase/Spark等,发送到kafka后,解析处理使用neo4j生成血缘☆81Updated 3 years ago
- flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0☆110Updated 2 years ago
- DorisDB SQL解析器Java实现;Clickhouse SQL解析器Java实现☆92Updated 2 years ago
- 基于 Flink 的 sqlSubmit 程序☆144Updated 10 months ago
- 汇总Apache Hudi中的一些Demo,便于快速上手Apache Hudi(Apache Hudi Demos to help beginners know about Hudi)☆74Updated 4 years ago
- 从本地IDEA提交Flink/Spark任务到Yarn/k8s集群☆161Updated 3 years ago
- flink sql connector clickhouse zeppelin☆79Updated 2 years ago
- Flink 菜鸟公众号代码地址☆64Updated last month
- Using Flink SQL to build ETL job☆200Updated last year
- Learning Flink : Flink CEP,Flink Core,Flink SQL☆71Updated 2 years ago
- Doris表和 字段血缘项目☆77Updated 9 months ago
- sql解析工具。主要解析hive sql、spark sql、presto sql。从sql中解析出输入表、输出表以及字段等信息☆94Updated last year
- 通过语法树解析获取字段级血缘数据☆60Updated last year
- FlinkSQL数据脱敏和行级权限解决方案及源码,支持面向用户级别的数据脱敏和行级数据访问控制,即特定用户只能访问到脱敏后的数据或授权过的行。此方案是实时领域Flink的解决方案,类似于离线数仓Hive Ranger中的Row-level Filter和Column Mas…☆131Updated last year
- ☆118Updated last year
- Hive hook, obtain task information from Hive, fetch input/output tables and lineage information from HSQL.☆39Updated last year
- presto hbase connector 组件基于Presto Connector接口规范实现,用来给Presto增加查询HBase的功能。相比其他开源版本的HBase Connector,我们的性能要快10到100倍以上。☆241Updated 2 years ago
- hive sql 字段血缘☆22Updated 2 years ago
- ☆38Updated last year
- 基于flink 1.8 源码二次开发,详见MD☆82Updated 4 years ago
- Make data connection easier☆22Updated 2 years ago
- 基于Apache-bahir-kudu-connector的flink-connector-kudu,支持Flink1.11.x DynamicTableSource/Sink,支持Range分区等☆46Updated last year
- HBaseManager,是一款强大的HBase表管理系统,目前系统集成的功能有,命名空间管理,表管理,列簇管理,标签机制,快照管理,以及一些常见的统计指标展示等,另外,系统还内置了HBaseSQL的功能,欢迎大家尝鲜。☆79Updated 9 months ago
- 基于flink1.9.1,flink-sql-client模块SDK单独实现,支持Yarn集群的远程SQL任务发布,可以支撑flink sql任务的远程化执行☆48Updated 2 years ago
- Flink Sql 教程☆34Updated last month
- Platform for Flink☆283Updated 2 years ago
- Atlas官方文档中文版☆69Updated 5 years ago
- Apache StreamPark quickstart☆68Updated this week
- ☆46Updated 5 years ago
- 此项目主要应用于数据中台或数据平台的数据总线,支持直接实时监听MySQL、MongoDB、PostgreSQL、Oracle、SQL Server、Db2和Cassandra等数据库的数据变更。☆62Updated last year