IntegriChain1 / s3parq
Parquet file management in S3 for Athena / Spectrum / Presto partitioning
☆22Updated this week
Related projects ⓘ
Alternatives and complementary repositories for s3parq
- Data Catalog for Databases and Data Warehouses☆31Updated 10 months ago
- Amundsen Gremlin☆20Updated 2 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Updated last year
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆19Updated last month
- A collection of python utility functions☆12Updated 4 months ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆29Updated 2 months ago
- The sane way of building a data layer in Airflow☆24Updated 4 years ago
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 3 years ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆19Updated 4 years ago
- A conda-smithy repository for python-duckdb.☆13Updated 2 weeks ago
- a pytest plugin for dbt adapter test suites☆19Updated last year
- Dask integration for Snowflake☆30Updated last week
- Amazon EMR on EKS Custom Image CLI☆25Updated last month
- ☆53Updated last year
- Stitch together multiple identities within your warehouse☆17Updated 8 months ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- Make dbt great again! Enables end user to extend dbt to his/her needs☆13Updated this week
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 2 years ago
- The elegance of Airflow + the power of AWS☆50Updated 9 months ago
- dbt adapter for Athena☆39Updated 5 months ago
- Example Set up For DBT Cloud using Github Integrations☆11Updated 4 years ago
- ☆66Updated 5 months ago
- Python utility for caching in Lambda Functions☆38Updated 4 years ago
- Puppet module to provision Airbnb's Airflow☆19Updated 2 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 7 years ago
- Convert JSON files to Parquet using PyArrow☆94Updated 10 months ago
- Palm CLI - the tool-belt for data teams☆47Updated 8 months ago
- Python library and DSL for working with AWS StepFunctions☆35Updated 2 weeks ago
- An experimental Athena extension for DuckDB 🐤☆50Updated 9 months ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆44Updated last year