PastorGL / datacooker-etl
ETL processing tool with SQL-like language and GIS capabilities, built on core Spark. Extensible and modular. Rich CLI included
☆16Updated this week
Alternatives and similar repositories for datacooker-etl:
Users that are interested in datacooker-etl are comparing it to the libraries listed below
- ITSumma Spark Greenplum Connector☆36Updated 10 months ago
- ☆18Updated 3 years ago
- This project is used to capture machine learning pipelines created on top of Spark as OK☆52Updated 2 years ago
- Data catalog for everything in your company☆50Updated last year
- One ETL tool to rule them all☆71Updated this week
- DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.☆57Updated last year
- k-means on Clickhouse SQL☆25Updated 3 years ago
- How to build your first Spark application with MLlib, StructuredStreaming, GraphFrames, Datasets and so on? Answer is here!☆53Updated 5 years ago
- Module for pipelines concept in PySpark☆15Updated 10 months ago
- An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.☆41Updated 4 months ago
- Data Engineering Digest☆27Updated 7 months ago
- Docker Compose with Almond.sh core for Jupyter☆17Updated 5 months ago
- Distributed run of dbt models using Airflow☆143Updated last month
- Native Spark OSM PBF data source☆18Updated 10 months ago
- Toolkit for Agile-driven data modeling and data loading using highly Normalized hybrid Model☆19Updated last month
- BigData analytics platform☆17Updated this week
- ☆12Updated 2 years ago
- YTsaurus SPYT provides an integration with Apache Spark☆15Updated this week
- Automated case classes validation using refinement types and macros☆14Updated 9 months ago
- ☆24Updated last year
- The most popular ClickHouse plugin for Airflow. 🔝 Top-1% downloads on PyPI: https://pypi.org/project/airflow-clickhouse-plugin! Based on…☆150Updated 5 months ago
- JDBCX: Extended JDBC driver for dynamic multi-language queries with optional bridge server for federated datasource connectivity.☆22Updated 2 weeks ago
- SparkConnect Server plugin and protobuf messages for the Amazon Deequ Data Quality Engine.☆26Updated this week
- Clickhouse Scala Client with Reactive Streams support☆114Updated last week
- ☆76Updated 2 years ago
- Learning resources for Airflow Tutorial article.☆55Updated 4 years ago
- Vostok Hercules is an open-source distributed system based on Apache Kafka and used for reliable delivery of telemetry data from microser…☆43Updated last year
- Список ресурсов для изучения scala☆58Updated 2 years ago
- https://habr.com/ru/post/279833/☆38Updated 8 years ago