PastorGL / datacooker-etl
ETL processing tool with SQL-like language and GIS capabilities, built on core Spark. Extensible and modular. Rich CLI included
☆16Updated this week
Alternatives and similar repositories for datacooker-etl:
Users that are interested in datacooker-etl are comparing it to the libraries listed below
- ITSumma Spark Greenplum Connector☆36Updated 10 months ago
- ☆18Updated 3 years ago
- This project is used to capture machine learning pipelines created on top of Spark as OK☆52Updated 2 years ago
- Data catalog for everything in your company☆51Updated last year
- One ETL tool to rule them all☆71Updated this week
- DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.☆57Updated last year
- ☆24Updated last year
- UDF to seamlessly connect ClickHouse to Vertica using external tables☆16Updated 2 years ago
- BigData analytics platform☆17Updated this week
- Complex event processing engine for time series data☆18Updated 2 weeks ago
- Data Engineering Digest☆27Updated 7 months ago
- k-means on Clickhouse SQL☆24Updated 3 years ago
- Automated case classes validation using refinement types and macros☆14Updated 8 months ago
- Список ресурсов для изучения scala☆58Updated 2 years ago
- ☆45Updated 5 months ago
- Clickhouse Scala Client with Reactive Streams support☆113Updated this week
- Spark in Kubernetes☆39Updated 7 months ago
- JDBCX: Extended JDBC driver for dynamic multi-language queries with optional bridge server for federated datasource connectivity.☆21Updated last week
- How to build your first Spark application with MLlib, StructuredStreaming, GraphFrames, Datasets and so on? Answer is here!☆53Updated 5 years ago
- ☆76Updated 2 years ago
- Distributed run of dbt models using Airflow☆144Updated last month
- The most popular ClickHouse plugin for Airflow. 🔝 Top-1% downloads on PyPI: https://pypi.org/project/airflow-clickhouse-plugin! Based on…☆147Updated 5 months ago
- SparkConnect Server plugin and protobuf messages for the Amazon Deequ Data Quality Engine.☆26Updated 2 months ago
- Vostok Hercules is an open-source distributed system based on Apache Kafka and used for reliable delivery of telemetry data from microser…☆43Updated last year
- Toolkit for Agile-driven data modeling and data loading using highly Normalized hybrid Model☆19Updated last month
- Docker Compose with Almond.sh core for Jupyter☆17Updated 4 months ago
- Module for pipelines concept in PySpark☆15Updated 10 months ago
- ☆22Updated last year
- ☆35Updated this week
- Nested array transformation helper extensions for Apache Spark☆37Updated last year