Performant Redshift data source for Apache Spark
☆140Jan 15, 2026Updated last month
Alternatives and similar repositories for spark-redshift
Users that are interested in spark-redshift are comparing it to the libraries listed below
Sorting:
- ☆25Mar 12, 2024Updated last year
- A protobuf serde for Kafbat UI using a protobuf descriptor file☆17Dec 4, 2025Updated 3 months ago
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆11May 22, 2018Updated 7 years ago
- A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.☆13Oct 27, 2021Updated 4 years ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆227Mar 19, 2025Updated 11 months ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Oct 17, 2023Updated 2 years ago
- 💰 Get Real-Time Cryptocurrency Price and Up-to-Date Status in your Alfred Workflow☆17Jun 21, 2025Updated 8 months ago
- This is the documentation for the Amazon Redshift Developer Guide☆121Jun 15, 2023Updated 2 years ago
- A tool for running Spark on Google Compute Engine☆16Jan 20, 2017Updated 9 years ago
- A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).☆18Apr 20, 2024Updated last year
- Amazon Redshift SQLAlchemy Dialect☆223Jul 3, 2024Updated last year
- Metadata and data identification tool and Python library. Identifies PII, common identifiers, language specific identifiers. Fully custom…☆46Jan 1, 2026Updated 2 months ago
- ☆24Oct 3, 2023Updated 2 years ago
- Apache Spark Sentry Integration☆16Aug 13, 2021Updated 4 years ago
- Plug-and-play implementation of an Apache Spark custom data source for AWS DynamoDB.☆174Mar 6, 2021Updated 4 years ago
- Spark to Tableau Extractor library☆19Oct 23, 2017Updated 8 years ago
- Amazon Managed Service for Apache Flink Benchmarking Utility helps with capacity planning, integration testing, and benchmarking of Amazo…☆21Aug 30, 2023Updated 2 years ago
- Testing library for pyspark, inspired from pandas testing module but for pyspark, to help users write unit tests.☆21Dec 18, 2023Updated 2 years ago
- A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational e…☆110Feb 2, 2026Updated last month
- Redshift Python Connector. It supports Python Database API Specification v2.0.☆218Feb 9, 2026Updated 3 weeks ago
- ☆27May 13, 2025Updated 9 months ago
- Typescript overlay to easily interact with DynamoDB. Fluid syntax library offering pagination, auto-escape of reserved words and many mor…☆11Jul 15, 2024Updated last year
- In this workshop you will launch an Amazon Redshift cluster in your AWS account and load sample data ~ 100GB using TPCH dataset. You will…☆24Nov 28, 2018Updated 7 years ago
- Astronomer Core Docker Images☆105May 22, 2024Updated last year
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆62Jun 15, 2023Updated 2 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,588Feb 17, 2026Updated 2 weeks ago
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆117Dec 26, 2022Updated 3 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆587Jan 24, 2024Updated 2 years ago
- Samples for ExRam.Gremlinq.☆27Jan 3, 2024Updated 2 years ago
- ☆38May 22, 2024Updated last year
- PySpark data-pipeline testing and CICD☆28Oct 28, 2020Updated 5 years ago
- ☆30Sep 29, 2023Updated 2 years ago
- Amazon Redshift Advanced Monitoring☆272Oct 28, 2025Updated 4 months ago
- Python API for Deequ☆814Jan 21, 2026Updated last month
- WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging …☆31Oct 28, 2025Updated 4 months ago
- Export Airflow metrics (from mysql) in prometheus format☆29Apr 15, 2025Updated 10 months ago
- Repository for AWS DBS Reference Architectures - Enterprise Data Warehousing☆35Jan 17, 2019Updated 7 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆187Oct 15, 2025Updated 4 months ago
- Live-updating Spark UI built with Meteor☆190Apr 6, 2021Updated 4 years ago