vangheem / sync-ftp-to-s3
simple python script to sync a ftp server folder to s3 bucket
☆42Updated 9 years ago
Alternatives and similar repositories for sync-ftp-to-s3:
Users that are interested in sync-ftp-to-s3 are comparing it to the libraries listed below
- AWS Lambda function that runs the copy command into Redshift☆40Updated 8 years ago
- Reference Architectures for Datalakes on AWS☆79Updated 4 years ago
- Cloudformation and SQL scripts used to replicate a POC environment from the "Data Lake to Data Warehouse: Enhancing Customer 360 with Ama…☆31Updated 4 years ago
- ☆26Updated 4 years ago
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆84Updated last year
- AWS Lambda Function to connect to FTP, download files and save them to S3 bucket☆66Updated 5 months ago
- ☆22Updated 4 years ago
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆116Updated 2 years ago
- ☆52Updated 5 years ago
- Required packages for using pandas in AWS Lambda functions☆45Updated 8 years ago
- A project providing a Lambda Layer that provides SQLite support in Python3.6 Lambdas☆25Updated 6 years ago
- ☆53Updated last year
- Ingestion of bid requests through Amazon Kinesis Firehose and Kinesis Data Analytics. Data lake storage with Amazon S3. Restitution with …☆26Updated 2 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- ☆29Updated 9 months ago
- ☆34Updated 2 years ago
- This GitHub project provides a series of lab exercises which help users get started using the Redshift platform.☆53Updated 3 years ago
- AWS Batch 101☆18Updated 6 years ago
- A solutions that automatically configures the AWS services necessary to easily capture, store, process, and deliver streaming data. This …☆92Updated last month
- Git repo to accompany the AWS DevOps Blog: Using AWS DevOps Tools to model and provision AWS Glue workflows☆19Updated 3 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 6 years ago
- PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).☆95Updated last year
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆334Updated 9 months ago
- Sample codes, blogs, and demos on how to use Amazon AppFlow.☆26Updated 6 months ago
- Presto-like CLI tool for AWS Athena☆85Updated 2 years ago
- Sample Apache Beam pipeline that can be deployed to Amazon Managed Service for Apache Flink. It reads taxi events from a Kinesis data str…☆46Updated last year
- Concat multiple files in s3☆39Updated last year
- The open source version of the AWS Glue docs. You can submit feedback & requests for changes by submitting issues in this repo or by maki…☆198Updated last year