Delta-Lake, ETL, Spark, Airflow
☆49Oct 9, 2022Updated 3 years ago
Alternatives and similar repositories for AcidOnSpark-ETL
Users that are interested in AcidOnSpark-ETL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project with Airflow + Spark + MinIO + Postgres + Python3.8☆29Sep 9, 2022Updated 3 years ago
- ☆15Oct 10, 2025Updated 10 months ago
- ☆41Jan 24, 2023Updated 3 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Guide on how to setup Apache Airflow containers using Docker and IBM Bluemix☆11Feb 19, 2018Updated 8 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Spark and Hive docker containers sharing a common MySQL metastore☆26Apr 17, 2020Updated 6 years ago
- a simple lakeFS webhook for pre-commit and pre-merge validation of data objects☆13Nov 9, 2023Updated 2 years ago
- Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraf…☆34Updated this week
- A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.☆12Jan 5, 2024Updated 2 years ago
- ☆10Jul 21, 2022Updated 4 years ago
- ☆95Sep 14, 2022Updated 3 years ago
- Build a data pipeline with Apache Airflow☆11May 7, 2021Updated 5 years ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Mar 25, 2024Updated 2 years ago
- ☆57Aug 14, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Collection of dockerized ETL jobs managed by data engineering.☆24Updated this week
- ☆13Nov 28, 2020Updated 5 years ago
- A minimal docker compose setup for experimenting with cloud agnostic Lakehouse Architectures Apache Spark with Hive Metastore + Delta Lak…☆34Apr 17, 2024Updated 2 years ago
- ☆18Mar 24, 2020Updated 6 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- ☆10Jul 24, 2024Updated 2 years ago
- ☆11Mar 7, 2021Updated 5 years ago
- Nyc_Taxi_Data_Pipeline - DE Project☆155Oct 21, 2024Updated last year
- A two part tutorial for Ray Core APIs and Ray Serve for Model Deployment☆21Jun 9, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This is a sample for installing Kubernetes on Bare metals Production servers ( Ubuntu distro )☆10Jan 9, 2021Updated 5 years ago
- universal-datalakehouse-postgres-ingestion-deltastreamer☆10Apr 7, 2024Updated 2 years ago
- An automatic paraphraser/summarizer/information extractor built using Python.☆18Apr 1, 2016Updated 10 years ago
- ☆73Jan 16, 2024Updated 2 years ago
- PyTorch library for breast cancer metastasis detection in whole-slide images of sentinel lymph node tissue from the Camelyon dataset☆15Nov 25, 2019Updated 6 years ago
- A collection of small dash apps which I created for learning purposes. Some of them answer questions asked on the plotly forum. https://c…☆11Feb 8, 2024Updated 2 years ago
- Basic CRUD with Python Flask & PostgreSQL Database☆17Feb 26, 2024Updated 2 years ago
- Flights Search Application GRANDstack Experimental Implementation☆23Mar 4, 2023Updated 3 years ago
- Example of a Streamlit data app powered by Vaex☆11Jul 7, 2022Updated 4 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- One-click deployment for Machine Learning apps☆24Feb 6, 2019Updated 7 years ago
- Unsupported. A python module for controlling "MagicLight Wifi Smart LED Light Bulbs" for getting around the Android or iOS app.☆10Jun 7, 2018Updated 8 years ago
- This is an ultra-simple example of using Langchain, Chroma and OpenAI for chatting with your documents☆12Oct 5, 2023Updated 2 years ago
- A short demo to introduce the polars dataframe library through a marimo notebook.☆25Jan 29, 2025Updated last year
- My initial aim is to write the web-crawler to grap content from the sites with the job offers and resumes to provide the single index and…☆19May 25, 2011Updated 15 years ago
- A GPU-vs-CPU performance benchmark: (OmniSci [MapD] Core DB / cuDF GPU DataFrame) vs (Pandas DataFrame / Postgres / PDAL)☆14Apr 27, 2019Updated 7 years ago
- dbt Cloud pipelines in airflow examples☆37Oct 30, 2023Updated 2 years ago