PastorGL / datacooker-etl
ETL processing tool with SQL-like language and GIS capabilities, built on core Spark. Extensible and modular. Rich CLI included
☆16Updated this week
Alternatives and similar repositories for datacooker-etl:
Users that are interested in datacooker-etl are comparing it to the libraries listed below
- ITSumma Spark Greenplum Connector☆36Updated 11 months ago
- ☆18Updated 3 years ago
- This project is used to capture machine learning pipelines created on top of Spark as OK☆52Updated 2 years ago
- Data catalog for everything in your company☆50Updated last year
- ☆12Updated 2 years ago
- One ETL tool to rule them all☆71Updated this week
- JDBCX: Extended JDBC driver for dynamic multi-language queries with optional bridge server for federated datasource connectivity.☆22Updated last month
- Automated case classes validation using refinement types and macros☆14Updated 10 months ago
- How to build your first Spark application with MLlib, StructuredStreaming, GraphFrames, Datasets and so on? Answer is here!☆53Updated 5 years ago
- ☆45Updated 7 months ago
- k-means on Clickhouse SQL☆25Updated 3 years ago
- ☆24Updated last year
- Data Engineering Digest☆27Updated 8 months ago
- Spark in Kubernetes☆39Updated 9 months ago
- DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.☆57Updated last year
- Kafka Connector for Iceberg tables☆16Updated last year
- RBKmoney Antifraud Service☆43Updated last year
- Complex event processing engine for time series data☆18Updated last month
- Vostok Hercules is an open-source distributed system based on Apache Kafka and used for reliable delivery of telemetry data from microser…☆43Updated last year
- ☆22Updated last year
- Toolkit for Agile-driven data modeling and data loading using highly Normalized hybrid Model☆20Updated 2 months ago
- ☆24Updated 4 years ago
- ☆24Updated 2 years ago
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆9Updated last year
- Airflow declarative DAGs via YAML☆132Updated last year
- An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.☆41Updated 5 months ago
- SparkConnect Server plugin and protobuf messages for the Amazon Deequ Data Quality Engine.☆26Updated 3 weeks ago
- Example Flink and Kafka integration project☆15Updated 9 years ago
- ☆37Updated last week