aws / aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
☆3,934Updated this week
Related projects ⓘ
Alternatives and complementary repositories for aws-sdk-pandas
- AWS Glue code samples☆1,435Updated last week
- PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.☆463Updated 3 months ago
- A developer toolkit to implement Serverless best practices and increase developer velocity.☆2,890Updated this week
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆642Updated 6 months ago
- This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) env…☆694Updated last month
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,309Updated last month
- Python API for Deequ☆730Updated last month
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,913Updated this week
- Enterprise-grade, production-hardened, serverless data lake on AWS☆419Updated this week
- Guides and docs to help you get up and running with Apache Airflow.☆800Updated 2 years ago
- A collection of sample scripts to customize Amazon SageMaker Notebook Instances using Lifecycle Configurations☆422Updated 7 months ago
- Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment☆2,772Updated this week
- Dynamically generate Apache Airflow DAGs from YAML configuration files☆1,209Updated this week
- ☆1,123Updated 5 months ago
- The Amazon Athena Query Federation SDK allows you to customize Amazon Athena with your own data sources and code.☆560Updated this week
- A library for training and deploying machine learning models on Amazon SageMaker☆2,104Updated this week
- Always know what to expect from your data.☆9,997Updated this week
- Curated list of resources about Apache Airflow☆3,691Updated 3 months ago
- Utility functions for dbt projects.☆1,379Updated last week
- Python Serverless Microframework for AWS☆10,665Updated 3 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,552Updated 6 months ago
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,013Updated last month
- ⚡️🐍📦 Serverless plugin to bundle Python packages☆1,110Updated last month
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆331Updated 7 months ago
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,215Updated 3 weeks ago
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,204Updated last month
- The low-level, core functionality of boto3 and the AWS CLI.☆1,505Updated this week
- Snowflake Connector for Python☆599Updated this week
- Turbine: the bare metals that gets you Airflow☆377Updated 3 years ago