Alternatives and similar repositories for spark-redshift

Users that are interested in spark-redshift are comparing it to the libraries listed below

• awslabs / aws-glue-data-catalog-client-for-apache-hive-metastore
  The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…
  ☆227Updated 9 months ago
• qubole / kinesis-sql
  Kinesis Connector for Structured Streaming
  ☆137Updated last year
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated this week
• danielvdende / data-testing-with-airflow
  ☆202Updated 2 years ago
• mrpowers-io / spark-daria
  Essential Spark extensions and helper methods ✨😲
  ☆766Updated 3 months ago
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆204Updated last year
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆271Updated last year
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 5 years ago
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆77Updated 7 years ago
• aws-samples / emr-serverless-samples
  Example code for running Spark and Hive jobs on EMR Serverless.
  ☆168Updated last year
• villasv / aws-airflow-stack
  Turbine: the bare metals that gets you Airflow
  ☆379Updated 4 years ago
• aws-samples / amazon-deequ-glue
  Automated data quality suggestions and analysis with Deequ on AWS Glue
  ☆90Updated 3 years ago
• Tomme / dbt-athena
  The athena adapter plugin for dbt (https://getdbt.com)
  ☆140Updated 2 years ago
• audienceproject / spark-dynamodb
  Plug-and-play implementation of an Apache Spark custom data source for AWS DynamoDB.
  ☆175Updated 4 years ago
• amundsen-io / amundsenmetadatalibrary
  Metadata service library for Amundsen
  ☆82Updated this week
• hellonarrativ / spectrify
  Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.
  ☆117Updated 3 years ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆222Updated 5 years ago
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆588Updated last year
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆259Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated last month
• aws / aws-emr-best-practices
  A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational e…
  ☆109Updated 3 months ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 months ago
• GoogleCloudDataproc / spark-bigquery-connector
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
  ☆416Updated last week
• qubole / sparklens
  Qubole Sparklens tool for performance tuning Apache Spark
  ☆586Updated last year
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆175Updated 7 months ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆87Updated 7 months ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 3 years ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆682Updated 10 months ago
• awslabs / aws-glue-libs
  AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
  ☆692Updated last year
• mrpowers-io / spark-fast-tests
  Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
  ☆453Updated this week