datax数据同步elasticsearch的reader和writer插件,支持一对多的扁平数据转换成es的嵌套对象,也支持嵌套对象的读取和ognl表达式过滤,理论上可以无限嵌套。
☆91Jul 12, 2025Updated 8 months ago
Alternatives and similar repositories for datax-elasticsearch
Users that are interested in datax-elasticsearch are comparing it to the libraries listed below
Sorting:
- elasticsearch reader and writer plugin for datax☆39Aug 31, 2017Updated 8 years ago
- A library based on Hudi for Spark.☆10Nov 30, 2021Updated 4 years ago
- hudi-spark-utilities-plus☆11Jul 29, 2022Updated 3 years ago
- DataX 是阿里巴巴集团内被广泛使用的离线数据同步工具/平台,实现包括 MySQL、Oracle、HDFS、Hive、OceanBase、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。☆139Mar 24, 2022Updated 3 years ago
- 为DataX(https://github.com/alibaba/DataX) 提供远程多语言调用(ThriftServer,HttpServer) 分布式运行(DataX on YARN) 功能☆143Jan 22, 2026Updated last month
- A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly☆1,405Mar 12, 2026Updated last week
- DataX集成可视化页面,选择数据源即可一键生成数据同步任务,支持RDBMS、Hive、HBase、ClickHouse、MongoDB等数据源,批量创建RDBMS数据同步任务,集成开源调度系统,支持分布式、增量同步数据、实时查看运行日志、监控执行器资源、KILL运行进程、…☆5,988Jun 2, 2024Updated last year
- ☆19Jun 10, 2021Updated 4 years ago
- DataX是阿里云DataWorks数据集成的开源版本。☆17,143Jul 1, 2025Updated 8 months ago
- ranger and ldap demo☆10Apr 14, 2023Updated 2 years ago
- hive sql 字段血缘☆24Jun 21, 2022Updated 3 years ago
- presto hbase connector 组件基于Presto Connector接口规范实现,用来给Presto 增加查询HBase的功能。相比其他开源版本的HBase Connector,我们的性能要快10到100倍以上。☆241Jan 2, 2023Updated 3 years ago
- Ansible playbooks to help to deploy Apache Hadoop,Spark,Storm,Zookeeper,Elasticsearch,Azkaban,Flume,Hbase,Kafka,Kibana,Logstash☆10Mar 21, 2017Updated 9 years ago
- 基于 antlr4 的多种数据库SQL解析器,获取SQL中元数据,可用于数据平台产品中的多个场景:ddl语句提取元数据、sql 权限校验、表级血缘、sql语法校验等场景。支持spark、flink、gauss、starrocks、Oracle、MYSQL、Postgresq…☆407Mar 10, 2026Updated last week
- FlinkSQL数据脱敏和行级权限解决方案及源码,支持面向用户级别的数据脱敏和行级数据访问控制,即特定用户只能访问到脱敏后的数据或授权过的行。此方案是实时领域Flink的解决方案,类似于离线数仓Hive Ranger中的Row-level Filter和Column Mas…☆147Oct 12, 2023Updated 2 years ago
- Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.☆3,706Mar 13, 2026Updated last week
- sql 血缘解析(hive sql、spark sql、starrocks sql、doris sql)☆26Feb 20, 2023Updated 3 years ago
- Spark、Flink等离线任务的调度以及实时任务的监控☆306Nov 13, 2025Updated 4 months ago
- A data integration framework☆4,109Dec 2, 2025Updated 3 months ago
- NGramSynonymTokenizer for Elasticsearch☆24Dec 14, 2021Updated 4 years ago
- DorisDB SQL解析器Java实现;Clickhouse SQL解析器Java实现☆101Jul 2, 2022Updated 3 years ago
- Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI☆1,289Updated this week
- SQL Lineage Analysis Tool powered by Python☆21Aug 25, 2023Updated 2 years ago
- 针对datax进行2次开发,实现data 以rpc的方式传递json配置调用推数服务,同时修复datax多处bug。项目中也引入nacos作为服务的配置中心和注册中心; 同时项目内扩展了kafkawriter,rabbitmqwriter,esreader,hiveread…☆70Dec 14, 2022Updated 3 years ago
- Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code☆14,186Updated this week
- Doris表和字段血缘项目☆89Apr 30, 2024Updated last year
- Spring Cloud Data Flow Streaming Example☆10Mar 17, 2018Updated 8 years ago
- dyanmic spring bean,controller/entity/dao/propertyEditor/manager(service)/interceptor bean compliled directly from java file real time li…☆11Jul 7, 2015Updated 10 years ago
- zabbix监控项目,including hard disk, nginx, php, docker, redis, and so on☆22Dec 27, 2024Updated last year
- 华为HBase普通客户端和安全模式客户端,包括建表、建索引、异步请求、Put、Get、Scan等功能☆11Jun 6, 2020Updated 5 years ago
- Elasticsearch-cdc plugin, which supports capture data changes in elasticsearch, and sink the cdc data into kafka.☆41Aug 21, 2021Updated 4 years ago
- 使用spring-boot-spark的一个样例☆11Aug 3, 2018Updated 7 years ago
- XiaoYu 基于 Spring Cloud Alibaba的分布式微服务快速搭建案例,具有统一授权、认证,包含用户管理、资源权限管理(Spring Security + oauth2)、网关API(Gateway)、分布式事务(seata)、分布式任务调度(xxl-job…☆22Jan 11, 2021Updated 5 years ago
- 微信聊天记录生成词云(SQLite+WordCloud使用)☆10Sep 18, 2019Updated 6 years ago
- socket上传文件,续传,多用户上传☆15Jul 9, 2015Updated 10 years ago
- 使用shell脚本部署Apache Doris (incubating) FE & BE☆11Jul 8, 2019Updated 6 years ago
- hive插件获取表级别、字段级别血缘关系☆11Jun 8, 2021Updated 4 years ago
- Apache Flink Connectors for OceanBase.☆25Jan 20, 2026Updated 2 months ago
- Distributed redis lock implemented and integrated with spring boot.☆16Nov 5, 2019Updated 6 years ago