KennethanCeyer / awesome-data-pipelineLinks
Awesome list for datapipeline
☆34Updated 2 years ago
Alternatives and similar repositories for awesome-data-pipeline
Users that are interested in awesome-data-pipeline are comparing it to the libraries listed below
Sorting:
- Apache Spark Guide☆31Updated 3 years ago
- A curated list of awesome open source tools and commercial products to catalog, version, and manage data 🚀☆33Updated 3 years ago
- Apache Airflow Guide☆28Updated last year
- A curated list of awesome DataOps tools☆191Updated this week
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- Data Tools Subjective List☆86Updated last year
- Awesome list of dataops products, open source and resources☆24Updated 3 years ago
- New generation opensource data stack☆70Updated 3 years ago
- dlt-dagster-demo☆11Updated last year
- A curated list of awesome Databricks resources, including Spark☆20Updated last year
- a collection of resources and blogs about Apache Superset☆83Updated 3 years ago
- A curated list of dagster code snippets for data engineers☆56Updated last year
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆29Updated last month
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 3 years ago
- A curated list of awesome blogs, videos, tools and resources about Data Contracts☆177Updated 11 months ago
- A curated list of awesome open source and commercial platforms for serving models in production 🚀☆39Updated 3 years ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Updated 2 years ago
- A curated list of awesome open source tools and commercial products that will help you manage machine learning and data-science workflows…☆24Updated 3 years ago
- A curated list of banking technologies and resources☆22Updated 2 years ago
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆121Updated last week
- dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.☆57Updated 3 years ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆59Updated this week
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆59Updated last year
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆86Updated 2 years ago
- A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.☆31Updated last year
- Fivetran data models for QuickBooks using dbt.☆34Updated this week
- ☆54Updated last week
- This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenario…☆25Updated 2 weeks ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆154Updated this week
- Open Source Data Quality Monitoring.☆156Updated this week