Delta-Lake, ETL, Spark, Airflow
☆50Oct 9, 2022Updated 3 years ago
Alternatives and similar repositories for AcidOnSpark-ETL
Users that are interested in AcidOnSpark-ETL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project with Airflow + Spark + MinIO + Postgres + Python3.8☆29Sep 9, 2022Updated 3 years ago
- ☆41Jan 24, 2023Updated 3 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Jul 13, 2022Updated 4 years ago
- A better SmartyStreets/LiveAddress API library for Python☆12Jan 2, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- a simple lakeFS webhook for pre-commit and pre-merge validation of data objects☆13Nov 9, 2023Updated 2 years ago
- Firefox extension that shows parquet schema when going over GCP cloud storage. Use DuckDB WASM☆12Jan 19, 2024Updated 2 years ago
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated last year
- Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraf…☆31May 30, 2026Updated last month
- A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.☆12Jan 5, 2024Updated 2 years ago
- ☆42Jul 4, 2022Updated 4 years ago
- The elegance of Airflow + the power of AWS☆51Feb 5, 2024Updated 2 years ago
- A data generator for Apache Druid☆12Mar 26, 2025Updated last year
- A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…☆29Aug 8, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆95Sep 14, 2022Updated 3 years ago
- Google Cloud Platform solution that provides an event driven process that flattens (unnests) Google Analytics 360 data that has been expo…☆16Apr 13, 2026Updated 3 months ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Mar 25, 2024Updated 2 years ago
- ☆57Aug 14, 2024Updated last year
- Collection of dockerized ETL jobs managed by data engineering.☆23Jul 22, 2026Updated last week
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆100Jan 31, 2023Updated 3 years ago
- Google Cloud Storage Python Client☆14Dec 26, 2022Updated 3 years ago
- A minimal docker compose setup for experimenting with cloud agnostic Lakehouse Architectures Apache Spark with Hive Metastore + Delta Lak…☆34Apr 17, 2024Updated 2 years ago
- ☆10Jul 24, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Mar 7, 2021Updated 5 years ago
- ☆24Jul 24, 2024Updated 2 years ago
- Wrapper for SurveyGizmo's restful API service☆16Sep 24, 2020Updated 5 years ago
- Repo for storing my solutions for the exercises in the Book "Data Structures and Algorithms in Python" by Goodrich, Tamassia, and Goldwas…☆19Apr 11, 2022Updated 4 years ago
- A repository to store example files and projects for my YouTube series **Docker Development Tips & Tricks**☆13Dec 1, 2021Updated 4 years ago
- Docker with Airflow and Spark standalone cluster☆264Aug 5, 2023Updated 2 years ago
- Nyc_Taxi_Data_Pipeline - DE Project☆151Oct 21, 2024Updated last year
- A Serverless project to help you operate on every existing item in a DynamoDB table☆17Mar 5, 2019Updated 7 years ago
- A two part tutorial for Ray Core APIs and Ray Serve for Model Deployment☆21Jun 9, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Telescopes, Workflows and Data Services for the Academic Observatory☆18Jul 21, 2026Updated last week
- This repository is no longer maintained.☆15Mar 10, 2022Updated 4 years ago
- High Performance Go Driver for Bytehouse☆15Jun 11, 2025Updated last year
- ☆15Nov 16, 2023Updated 2 years ago
- universal-datalakehouse-postgres-ingestion-deltastreamer☆10Apr 7, 2024Updated 2 years ago
- An automatic paraphraser/summarizer/information extractor built using Python.☆18Apr 1, 2016Updated 10 years ago
- ☆73Jan 16, 2024Updated 2 years ago