Real-time ETL developed by Flink, data from MySQL to Greenplum. Use canal to parse the MySQL binlog, put it into kafka, use Flink to consume kafka and assemble the data into Greenplum, and more data sources and target sources will be added in the future.
☆80Mar 21, 2024Updated last year
Alternatives and similar repositories for mriya
Users that are interested in mriya are comparing it to the libraries listed below
Sorting:
- 蜜蜂牧场是一个数据采集清洗工具，也是一个ETL工具，同时也是一套脚本语言。☆14Jul 1, 2018Updated 7 years ago
- 此项目主要应用于数据中台或数据平台的数据总线，支持直接实时监听MySQL、MongoDB、PostgreSQL、Oracle、SQL Server、Db2和Cassandra等数据库的数据变更。☆64Dec 5, 2023Updated 2 years ago
- flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0☆111Jun 21, 2022Updated 3 years ago
- Using Flink SQL to build ETL job☆206Sep 29, 2023Updated 2 years ago
- 执行Flink SQL 文件的客户端☆24Oct 19, 2021Updated 4 years ago
- 各种安全相关思维导图整理收集☆11Sep 7, 2015Updated 10 years ago
- Flink 实时ETL案例☆46Sep 8, 2022Updated 3 years ago
- yaml version of https://github.com/hboutemy/mcmm☆13Feb 5, 2026Updated 3 weeks ago
- Mirror of App Suite middleware code☆14Nov 14, 2022Updated 3 years ago
- 基于flink的营销系统☆14Jun 9, 2022Updated 3 years ago
- Some simple tools for greenplum db, tools developed include UDF, shell, perl etc.☆16Feb 12, 2026Updated 2 weeks ago
- 基于flink1.9.1,flink-sql-client模块SDK单独实现，支持Yarn集群的远程SQL任务发布，可以支撑flink sql任务的远程化执行☆47Jan 26, 2026Updated last month
- Image to run Greenplum☆27Jan 30, 2024Updated 2 years ago
- A distributed data factory, providing data access, etl, scheduling. Easily manage tasks such as hive, spark, clickhouse, flink, shell, py…☆33May 21, 2022Updated 3 years ago
- SQL语法词法分析 SQL表级血缘 SQL字段级别血缘 SQL函数血缘 SQL编译器☆17Nov 1, 2022Updated 3 years ago
- ☆17Oct 18, 2019Updated 6 years ago
- A data integration framework☆4,110Dec 2, 2025Updated 2 months ago
- Flink Sql 教程☆35Dec 2, 2024Updated last year
- 基于ansible的Greenplum集群多主机节点一键安装工具//dbswitch.gitee.io/docs-site/☆15Jul 4, 2021Updated 4 years ago
- This repo is deprecated, Please refer to https://github.com/glink-incubator/glink☆17Sep 29, 2023Updated 2 years ago
- AMS实时推荐系统☆17Nov 4, 2022Updated 3 years ago
- 分布式脚手架框架（总结整理）☆15Aug 27, 2015Updated 10 years ago
- 给flink开发的web系统。支持页面上定义udf，进行sql和jar任务的提交；支持source、sink、job的管理；可以管理openshift上的flink集群☆290Dec 16, 2022Updated 3 years ago
- 主要介绍作者使用过的Greenplum技术,欢迎大家交流☆232Feb 5, 2026Updated 3 weeks ago
- MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步，主要定位是为实时交易系统服务，亦可用于大数据的数据同步（ETL领域）。☆87Aug 13, 2025Updated 6 months ago
- A demo repository for "streaming etl" with Apache Flink☆44Jun 8, 2016Updated 9 years ago
- Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, res…☆814Dec 11, 2024Updated last year
- A dataset for Movie Recommendation with NebulaGraph, ETL to merge two dataset: OMDB & Movielens with dbt, postgres and Nebula-Importer☆17Sep 7, 2024Updated last year
- 京东RTF实时数据湖，是一个从底层重新构建的系统，解决了数据的接入、解析及清洗等ETL 过程，同时解决了传统离线模式达不到的实时性和流式实时数据做不到的数据清洗、还原，是一套大数据领域改革性的实时数据方案。RTF可以直接查询最新状态的数据，并且 无需去重，可以让数据分析人员即…☆128Sep 29, 2023Updated 2 years ago
- Example of using greenplum-spark connector☆20Feb 5, 2019Updated 7 years ago
- Real time data processing system based on flink and CEP☆253Dec 27, 2024Updated last year
- Bireme is an incremental synchronization tool for the Greenplum / HashData data warehouse☆138Feb 23, 2022Updated 4 years ago
- tensorflow serving and deep model online https://dataxujing.github.io/tensorflow-serving-Wechat/?transition=convex#/☆19Nov 23, 2018Updated 7 years ago
- Instructions for getting started with Ververica Platform on minikube.☆95Jul 9, 2025Updated 7 months ago
- mysql数据实时增量导入hive☆87Jun 15, 2017Updated 8 years ago
- 🎉 基于 reactjs 开发的可视化大屏设计器项目https://wuli-admin.gitee.io/react-wuli-admin/#/dashboard☆22Dec 16, 2020Updated 5 years ago
- 对alibaba datax的封装， 进行批量的导入导出，目前只支持没有mysql模板，其他可以自己创建模板，很简单☆19Dec 16, 2022Updated 3 years ago
- 分享一些在工作中的大数据实战案例，包括flink、kafka、hadoop、presto等等。 欢迎大家关注我的公众号【大数据技术与应用实战】，一起成长。☆260Feb 21, 2024Updated 2 years ago
- A simple project used to submit a Flink SQL script☆376Sep 2, 2019Updated 6 years ago