This module provides the functionality of uploading files to s3 from a FTP server. An SFTP connection is created with the FTP server and all the files present in the specified directory are uploaded to the specified s3 bucket. Following are the key features of this module: Creates a secure ssh connection with FTP server. Handles multipart upload…
☆13May 9, 2020Updated 6 years ago
Alternatives and similar repositories for Python-FTP-File-Ingestion
Users that are interested in Python-FTP-File-Ingestion are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python 3 script to transfer files from FTP server to AWS S3 bucket☆31Apr 2, 2021Updated 5 years ago
- ☆16Jun 27, 2020Updated 6 years ago
- Using Apache Airflow to author, run and monitor complex data pipelines.☆12Oct 24, 2018Updated 7 years ago
- ☆11Oct 11, 2022Updated 4 years ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Mar 2, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆14Apr 14, 2023Updated 3 years ago
- Basic Spark utilities☆13Jul 24, 2026Updated 2 months ago
- ☆15Sep 20, 2019Updated 7 years ago
- Demo code for testing with Pytest and Hypothesis☆14Oct 12, 2021Updated 5 years ago
- Tools for faster and optimized interaction with Teradata and large datasets.☆17Jul 11, 2018Updated 8 years ago
- This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark w…☆16May 21, 2026Updated 4 months ago
- API REST boilerplate using Spring Boot and Redis as database☆14Dec 26, 2018Updated 7 years ago
- Easy access of environment variables from Python with support for typing (ex. booleans, strings, lists, tuples, integers, floats, and dic…☆26May 24, 2026Updated 4 months ago
- Helper utils for our packages☆33Sep 25, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Due to lack of resources on how to deploy kafka with simple SASL authentication (just username and password) and how to write producer an…☆12Dec 29, 2021Updated 4 years ago
- Example to create lineage in Atlas with sqoop and spark☆14Apr 5, 2017Updated 9 years ago
- Repo for holding the dbt project used to make sense of cloud cost data from the major cloud platforms☆38Mar 1, 2020Updated 6 years ago
- Issues related to evolution of the C API☆19Jan 9, 2026Updated 9 months ago
- Blog post on ETL pipelines with Airflow☆23Aug 31, 2025Updated last year
- ☆16Apr 9, 2019Updated 7 years ago
- This is a fork of the Apache Flink Kinesis connector adding Enhanced Fanout support for Flink 1.8/1.11 on KDA.☆24Mar 1, 2026Updated 7 months ago
- Spark Structured Streaming JDBC Sink☆16Apr 26, 2021Updated 5 years ago
- ☆23Oct 3, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- SQL problems with solution & summary☆12May 2, 2021Updated 5 years ago
- Django generic marketplace API☆11Jun 10, 2020Updated 6 years ago
- The kubectl plugin which allows us to test IRSA configuration AWS sa☆24Nov 2, 2022Updated 3 years ago
- Demonstrates calling a Scala UDF from Python using spark-submit with an EGG and JAR☆23Mar 3, 2020Updated 6 years ago
- Example of using Faust with Docker☆23Sep 30, 2019Updated 7 years ago
- A toolset to streamline running spark python on EMR☆20Nov 16, 2016Updated 9 years ago
- Amazon EMR on EKS Custom Image CLI☆32Sep 26, 2024Updated 2 years ago
- Define the shape of your data with simple python data structures. Use those data descriptions to validate your application.☆43Jul 24, 2016Updated 10 years ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Nov 22, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka☆28Apr 23, 2026Updated 5 months ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Apr 17, 2020Updated 6 years ago
- Cloud based Data Platform based on Apache Spark☆28Jun 30, 2026Updated 3 months ago
- Test examples of kafka-clients: unit, integration, end-to-end☆27Nov 16, 2022Updated 3 years ago
- Tax-Brain is an integrator model for PSL tax models☆13Apr 13, 2026Updated 6 months ago
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Dec 31, 2024Updated last year
- PostgreSQL and GreenPlum Data Source for Apache Spark☆35May 6, 2026Updated 5 months ago