pawl / awesome-etlLinks
A curated list of awesome ETL frameworks, libraries, and software.
☆3,434Updated last year
Alternatives and similar repositories for awesome-etl
Users that are interested in awesome-etl are comparing it to the libraries listed below
Sorting:
- Actively curated list of awesome BI tools. PRs welcome!☆2,191Updated 11 months ago
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,426Updated 4 months ago
- ETL best practices with airflow, with examples☆1,340Updated 10 months ago
- A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow☆2,081Updated last year
- Curated list of resources about Apache Airflow☆3,822Updated 11 months ago
- Extract Transform Load for Python 3.5+☆1,599Updated 2 years ago
- This repository is a getting started guide to Singer.☆1,314Updated this week
- a curated list of awesome streaming frameworks, applications, etc☆2,866Updated 2 weeks ago
- A curated list of data engineering tools for software developers☆7,648Updated last week
- Python Extract Transform and Load Tables of Data☆1,282Updated 3 weeks ago
- A curated list of data engineering tools for software developers☆487Updated 8 years ago
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,621Updated last week
- Construct Apache Airflow DAGs Declaratively via YAML configuration files☆1,332Updated this week
- A curated list of awesome Apache Spark packages and resources.☆1,816Updated 9 months ago
- Docker Apache Airflow☆3,808Updated 2 years ago
- Guides and docs to help you get up and running with Apache Airflow.☆808Updated last week
- A list of useful Apache NiFi resources, processor bundles and tools☆959Updated 4 years ago
- An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.☆1,403Updated 5 years ago
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆11,204Updated this week
- A list of useful resources to learn Data Engineering from scratch☆3,839Updated last year
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,734Updated last year
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,473Updated last month
- [NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis☆1,483Updated 3 years ago
- A curated list of awesome big data frameworks, ressources and other awesomeness.☆13,762Updated 5 months ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,413Updated 2 months ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,515Updated 8 months ago
- Data Pipeline Framework using the singer.io spec☆649Updated last week
- ☆1,664Updated last week
- An Awesome List of Open-Source Data Engineering Projects☆2,654Updated 10 months ago
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,983Updated 2 weeks ago