ayshaysha / aws-csv-to-parquet-converterLinks
This Script gets CSV file from Amazon S3 using Python Library Boto3 and converts it to Parquet Format before uploading the new Parquet Version again to S3.
☆9Updated 3 weeks ago
Alternatives and similar repositories for aws-csv-to-parquet-converter
Users that are interested in aws-csv-to-parquet-converter are comparing it to the libraries listed below
Sorting:
- Fully unit tested utility functions for data engineering. Python 3 only.☆17Updated 9 months ago
- Serverless Datalake architecture☆12Updated 2 years ago
- aws-solutions-library-samples / guidance-for-preparing-and-validating-records-for-entity-resolution-on-awsThis Guidance demonstrates how to prepare and validate Personally Identifiable Information (PII) data, including physical address, phone,…☆9Updated 7 months ago
- DuckDB with Dashboarding tools demo evidence, streamlit and rill☆16Updated last year
- ☆11Updated last year
- ☆10Updated 8 months ago
- ☆11Updated 6 months ago
- This repository contains a series of 4 jupyter notebooks demonstrating how AWS AI Services like Amazon Rekognition, Amazon Transcribe and…☆11Updated 3 years ago
- This repository contains example patterns for storing large objects with DynamoDB.☆11Updated 11 months ago
- AWS Glue Configurable Test Data Generator for S3 Data Lakes and DynamoDB☆17Updated last year
- Samples and documentation for various advertising and marketing use cases on AWS.☆36Updated 2 years ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- AWS Quick Start Team☆23Updated 8 months ago
- A python package to create a database on the platform using our moj data warehousing framework☆21Updated 9 months ago
- This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenario…☆25Updated 6 months ago
- dApp authentication with Amazon Cognito and Web3 proxy with Amazon API Gateway☆13Updated 10 months ago
- This project uses the open-source model Mistral Small, deployed in Amazon SageMaker or invoked via API on Amazon Bedrock, to enable users…☆24Updated 2 months ago
- ☆52Updated this week
- ☆11Updated 10 months ago
- ☆17Updated last year
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆22Updated last year
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆51Updated last year
- Showcases the AsyncIO Functionality within Apache Flink for Kinesis Data Analytics☆10Updated 5 months ago
- The Dynamic Rules Engine is a serverless application that enables real-time evaluation of rules against sensor data, leveraging AWS Kines…☆11Updated 8 months ago
- A tool to automate analytic platform evaluations. Barometer helps customers to get data points needed for service selection/service confi…☆19Updated last year
- ☆15Updated 2 years ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 8 months ago
- ☆17Updated 3 years ago
- ☆14Updated 4 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago