Alternatives and similar repositories for stream-this-dataset

Users that are interested in stream-this-dataset are comparing it to the libraries listed below

• pathwaycom / pathway-benchmarks
  Benchmarks for data processing systems: Pathway, Spark, Flink, Kafka Streams
  ☆75Updated 3 months ago
• pathwaycom / cookiecutter-pathway
  Cookiecutter Pathway is a framework for jumpstarting production-ready Pathway projects quickly.
  ☆60Updated last year
• pathway-labs / pathway-examples
  Code examples for the Pathway programming framework
  ☆40Updated last year
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆70Updated 9 months ago
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆219Updated last month
• pathway-labs / azure-openai-real-time-data-app
  Real-time data pipeline for AI apps in Azure
  ☆25Updated last year
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆84Updated 2 years ago
• boringdata / boring-semantic-layer
  ☆63Updated this week
• renardeinside / databricks-streamlit-demo
  Demo of Streamlit application with Databricks SQL Endpoint
  ☆35Updated 2 years ago
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆50Updated last year
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last week
• dbt-labs / dbt-meshify
  A dbt-core python package that automates the management and creation of dbt groups, contracts, access, and versions.
  ☆122Updated 5 months ago
• hussein-awala / spark-on-k8s
  A Python package to submit and manage Apache Spark applications on Kubernetes.
  ☆42Updated 2 months ago
• mehd-io / pypi-duck-flow
  end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence
  ☆208Updated last month
• luatnc87 / modern-data-warehouse-modeling-and-data-quality-with-dbt-openmetadata
  This repository serves as a comprehensive guide to effective data modeling and robust data quality assurance using popular open-source to…
  ☆30Updated last year
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆54Updated last month
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆96Updated this week
• Snowflake-Labs / orchestration-framework
  A multi-agent framework with native support for Snowflake services
  ☆54Updated last week
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆142Updated 11 months ago
• StabRise / spark-pdf
  PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it
  ☆69Updated 2 months ago
• ryft-io / iceberg-mcp
  ☆37Updated 2 months ago
• astronomer / ask-astro
  An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
  ☆240Updated 3 months ago
• garden-of-delete / airbyte-topiary
  Airbyte deployment and configuration management tool
  ☆12Updated 3 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆225Updated 8 months ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆195Updated this week
• dagster-io / project-dagster-university
  Dagster University courses
  ☆90Updated this week
• astronomer / cosmos-demo
  Demo DAGs that show how to run dbt Core in Airflow using Cosmos
  ☆62Updated last month
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆35Updated last year
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated 10 months ago
• boringdata / boring-catalog
  ☆132Updated last month