Spark app to merge different schemas
☆23Dec 21, 2020Updated 5 years ago
Alternatives and similar repositories for spark-schema-merge
Users that are interested in spark-schema-merge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Extensible streaming ingestion pipeline on top of Apache Spark☆47Jul 17, 2025Updated last year
- Hudi Demo Notebook☆11Mar 5, 2024Updated 2 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆53Oct 31, 2023Updated 2 years ago
- ☆18Dec 2, 2024Updated last year
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆24Sep 6, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The dbt-spark-livy adapter allows you to use dbt along with Apache Spark, by connecting via Apache Livy☆12Mar 30, 2023Updated 3 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆56May 6, 2023Updated 3 years ago
- ☆25Jul 4, 2023Updated 3 years ago
- Spark on Kubernetes samples☆20Jun 8, 2021Updated 5 years ago
- Code for training on Imagenet to SOTA results using PyTorch☆13Aug 14, 2023Updated 2 years ago
- Map your python dataclasses to pyspark types☆10Feb 11, 2024Updated 2 years ago
- A unit test framework for Databricks notebooks☆12Dec 8, 2020Updated 5 years ago
- Scripts for Azure Synapse SQL Pools (Provisioned) and Query-on-Demand (Serverless)☆11Nov 2, 2021Updated 4 years ago
- ☆16Apr 9, 2019Updated 7 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Example project for building scalable data pipelines with Kedro and Ibis.☆14Dec 10, 2025Updated 7 months ago
- Python code that will collapse structured columns separating out the attributes into new columns☆10Mar 15, 2022Updated 4 years ago
- hackUMBC old website☆11Jul 15, 2024Updated 2 years ago
- ☆12Oct 16, 2023Updated 2 years ago
- Publish / Deploy a Tabular or Multidimensional Cube to SSAS or AAS☆11Jul 14, 2025Updated last year
- Solving Captchas using Deep Learning☆13Apr 17, 2023Updated 3 years ago
- Minimalist implementation of VQ-VAE in Pytorch☆10Sep 9, 2018Updated 7 years ago
- ORM for Apache Spark and DataFrames schema manager☆16Jun 24, 2024Updated 2 years ago
- How to customize Tableau authentication using the AWS Athena's JDBC Credentials Provider capabilites.☆14Jun 8, 2020Updated 6 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Repository for Google Cloud Run Deep Dive☆11Jul 8, 2020Updated 6 years ago
- ☆12Aug 6, 2020Updated 5 years ago
- Various data stream/batch process demo with Apache Scala Spark 🚀☆12Feb 28, 2020Updated 6 years ago
- Examples of using various APIs from (mostly) Python☆16Jul 24, 2022Updated 4 years ago
- ☆11Sep 22, 2020Updated 5 years ago
- Scala examples for using Apache Beam Java API (2.1.0)☆12Nov 7, 2017Updated 8 years ago
- A collection of python utility functions☆11May 8, 2026Updated 2 months ago
- Passbolt CE installation scripts☆19Mar 16, 2021Updated 5 years ago
- Open source stack lakehouse☆25Mar 2, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A Terraform module to create and manage Identity and Access Management (IAM) Users on Amazon Web Services (AWS). https://aws.amazon.com/i…☆20Apr 6, 2022Updated 4 years ago
- ☆18May 22, 2024Updated 2 years ago
- Resources for Code Cafe Online 4th May 2020☆11May 5, 2020Updated 6 years ago
- pronounced sUrplus as it's simply better if not best!☆12Apr 20, 2021Updated 5 years ago
- code (R, Matlab/Octave), models and meta-models I needed in my Machine Learning Lab but I didn't found on the shelf☆18Apr 12, 2019Updated 7 years ago
- Simple docker image to serve textract as a REST-API☆14Jan 14, 2021Updated 5 years ago
- Collect and aggregate on spark events for profitz☆10Apr 22, 2022Updated 4 years ago