IntegriChain1 / s3parqLinks
Parquet file management in S3 for Athena / Spectrum / Presto partitioning
☆22Updated 8 months ago
Alternatives and similar repositories for s3parq
Users that are interested in s3parq are comparing it to the libraries listed below
Sorting:
- A collection of python utility functions☆11Updated last year
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Updated 2 years ago
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 4 years ago
- Data Catalog for Databases and Data Warehouses☆35Updated last year
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆84Updated 2 years ago
- Data pipelines from re-usable components☆107Updated 2 years ago
- AWS AppSync resolver that provides GraphQL access to Athena databases☆14Updated 2 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated 2 years ago
- CLI for data platform☆20Updated last year
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated 2 years ago
- The elegance of Airflow + the power of AWS☆51Updated last year
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆113Updated 2 months ago
- ☆54Updated last week
- Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0☆45Updated 3 years ago
- Airflow Executor for both AWS ECS & AWS Fargate☆52Updated 2 years ago
- An experimental Athena extension for DuckDB 🐤☆57Updated 9 months ago
- easy install parquet-tools☆182Updated last year
- The best Python package for comparing two dataframes☆12Updated 3 years ago
- Dask integration for Snowflake☆30Updated 2 months ago
- ☆16Updated 2 years ago
- Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR☆17Updated 5 months ago
- Utility functions for dbt projects running on Spark☆33Updated 7 months ago
- Continuously synchronize directories from remote object store to local filesystem☆106Updated this week
- ☆73Updated last year
- Write your dbt models using Ibis☆71Updated 6 months ago
- Amundsen Gremlin☆21Updated 3 years ago
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated 2 years ago
- Dask on ECS Fargate☆14Updated 6 years ago
- Reference Architectures for Datalakes on AWS☆78Updated 5 years ago