RoundYuanYuan / spark-field-lineage

Related projects ⓘ

Alternatives and complementary repositories for spark-field-lineage

• bill-cc / metadata-hive-hook
  Hive hook, obtain task information from Hive, fetch input/output tables and lineage information from HSQL.
  ☆39Updated last year
• GuoNingNing / fire-spark
  Spark 脚手架工程，标准化 spark 开发、部署、测试流程。
  ☆93Updated last month
• HamaWhiteGG / flink-sql-lineage
  The Lineage Analysis system for FlinkSQL supports advanced syntax such as Watermark, UDTF, CEP, Windowing TVFs, and CTAS.
  ☆369Updated 5 months ago
• HamaWhiteGG / flink-sql-security
  FlinkSQL数据脱敏和行级权限解决方案及源码，支持面向用户级别的数据脱敏和行级数据访问控制，即特定用户只能访问到脱敏后的数据或授权过的行。此方案是实时领域Flink的解决方案，类似于离线数仓Hive Ranger中的Row-level Filter和Column Mas…
  ☆121Updated last year
• scxwhite / parseX
  sql解析工具。主要解析hive sql、spark sql、presto sql。从sql中解析出输入表、输出表以及字段等信息
  ☆94Updated last year
• teeyog / blog
  My Blog
  ☆76Updated 6 years ago
• thestyleofme / data-lineage-parent
  数据血缘，Hive/Sqoop/HBase/Spark等，发送到kafka后，解析处理使用neo4j生成血缘
  ☆80Updated 3 years ago
• allwefantasy / spark-binlog
  A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
  ☆154Updated last year
• todd5167 / flink-spark-submiter
  从本地IDEA提交Flink/Spark任务到Yarn/k8s集群
  ☆162Updated 3 years ago
• 1996fanrui / fanrui-learning
  Flink, algorithm and Java learning code, I hope it will be useful to you.
  ☆67Updated last month
• webgjc / sql-parser
  基于antlr4的sql解析，实现格式化，元数据，血源等自定义解析，包括hive
  ☆107Updated last year
• eyesmoons / data-lineage-doris
  Doris表和字段血缘项目
  ☆73Updated 6 months ago
• flink-china / flink-forward-asia-hackathon-2021
  本 GitHub 项目是 Flink Forward Asia Hackathon (2021) 的投票专用项目。
  ☆121Updated 2 years ago
• leonardBang / flink-sql-etl
  Using Flink SQL to build ETL job
  ☆200Updated last year
• zhuxiaoshang / flink-be-god
  ☆117Updated last year
• Xiwu1994 / sql-parser
  hive sql 字段血缘
  ☆23Updated 2 years ago
• DonnyZone / ANTLR4-SqlBase
  剥离的模块，用于查看Spark SQL生成的语法树
  ☆89Updated 5 years ago
• springMoon / sqlSubmit
  基于 Flink 的 sqlSubmit 程序
  ☆144Updated 8 months ago
• lccbiluox2 / Antlr4-sqlParser
  spark,hive,等SQL解析案例
  ☆40Updated 5 years ago
• CrestOfWave / Spark-2.3.1
  Spark-2.3.1源码解读
  ☆198Updated last year
• frankyu8 / ushas
  This project is used for tracking lineage when using spark. Our team is aimed at enhancing the ability of column relation during logical …
  ☆19Updated 2 years ago
• YunKillerE / sparkStreamingKafkaPerformance
  spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议
  ☆33Updated 5 years ago
• hortonworks-spark / spark-atlas-connector
  A Spark Atlas connector to track data lineage in Apache Atlas
  ☆264Updated last year
• peopleindreamdontsleep / StructuredStreamingInSQL
  sql实现Structured Streaming
  ☆39Updated 5 years ago
• qindongliang / streaming-offset-to-zk
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆136Updated 3 months ago
• NetEase / hive-tools
  ☆46Updated 4 years ago
• MyLanPangzi / flink-demo
  Flink Demo
  ☆41Updated last year
• cubefs / compass
  Compass is a task diagnosis platform for bigdata
  ☆358Updated 2 months ago
• frb502 / spark-skewed-join-hint
  SparkSQL自定义Hint优化器解决热点数据导致JOIN数据倾斜问题
  ☆48Updated 5 years ago