This module provides the functionality of uploading files to s3 from a FTP server. An SFTP connection is created with the FTP server and all the files present in the specified directory are uploaded to the specified s3 bucket. Following are the key features of this module: Creates a secure ssh connection with FTP server. Handles multipart upload…
☆13May 9, 2020Updated 6 years ago
Alternatives and similar repositories for Python-FTP-File-Ingestion
Users that are interested in Python-FTP-File-Ingestion are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Jun 27, 2020Updated 6 years ago
- Using Apache Airflow to author, run and monitor complex data pipelines.☆12Oct 24, 2018Updated 7 years ago
- ☆11Oct 11, 2022Updated 3 years ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Mar 2, 2026Updated 5 months ago
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆14Apr 14, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Basic Spark utilities☆13Jul 24, 2026Updated 3 weeks ago
- A set of widgets for Python's Orange Machine Learning to work with Apache Spark ML☆15Dec 24, 2016Updated 9 years ago
- Tools for faster and optimized interaction with Teradata and large datasets.☆17Jul 11, 2018Updated 8 years ago
- The Demo for Blog: Modularization using Python and Docker (MicroService)☆11Feb 4, 2021Updated 5 years ago
- This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark w…☆16May 21, 2026Updated 2 months ago
- A pyspark lib to validate data quality☆19Nov 11, 2022Updated 3 years ago
- API REST boilerplate using Spring Boot and Redis as database☆13Dec 26, 2018Updated 7 years ago
- Helper utils for our packages☆33Updated this week
- Due to lack of resources on how to deploy kafka with simple SASL authentication (just username and password) and how to write producer an…☆12Dec 29, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Example to create lineage in Atlas with sqoop and spark☆14Apr 5, 2017Updated 9 years ago
- Repo for holding the dbt project used to make sense of cloud cost data from the major cloud platforms☆38Mar 1, 2020Updated 6 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 5 years ago
- Blog post on ETL pipelines with Airflow☆23Aug 31, 2025Updated 11 months ago
- ☆16Apr 9, 2019Updated 7 years ago
- Capstone Project for General Assembly's Data Science Immersive Course☆13May 8, 2017Updated 9 years ago
- ☆20Feb 14, 2018Updated 8 years ago
- SQL problems with solution & summary☆12May 2, 2021Updated 5 years ago
- Django generic marketplace API☆11Jun 10, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The kubectl plugin which allows us to test IRSA configuration AWS sa☆24Nov 2, 2022Updated 3 years ago
- Tools for working with icd codes and comorbidities☆26Apr 28, 2021Updated 5 years ago
- Demonstrates calling a Scala UDF from Python using spark-submit with an EGG and JAR☆23Mar 3, 2020Updated 6 years ago
- Example of using Faust with Docker☆23Sep 30, 2019Updated 6 years ago
- A toolset to streamline running spark python on EMR☆20Nov 16, 2016Updated 9 years ago
- Multi-stage, config driven, SQL based ETL framework using PySpark☆26Sep 16, 2019Updated 6 years ago
- Amazon EMR on EKS Custom Image CLI☆32Sep 26, 2024Updated last year
- Define the shape of your data with simple python data structures. Use those data descriptions to validate your application.☆43Jul 24, 2016Updated 10 years ago
- ☆26Apr 15, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Nov 22, 2021Updated 4 years ago
- Chapter 5 of the AWS Cookbook☆14Mar 13, 2022Updated 4 years ago
- An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka☆28Apr 23, 2026Updated 3 months ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Apr 17, 2020Updated 6 years ago
- Cloud based Data Platform based on Apache Spark☆28Jun 30, 2026Updated last month
- Portable scanner/printer that turns QR code menus into physical copies.☆16Oct 24, 2023Updated 2 years ago
- Notebooks which will provide a demo of Qgrid functionality☆20Jan 16, 2020Updated 6 years ago