nialloriordan / airbyte-airflow-scraper
Pipeline to scrape data from Linkedin using Airbyte and Airflow
☆19Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for airbyte-airflow-scraper
- Examples showing real-life use cases for fal + dbt☆22Updated 2 years ago
- Contribute to dlt verified sources 🔥☆72Updated 3 weeks ago
- A curated list of dagster code snippets for data engineers☆52Updated 8 months ago
- Full stack data engineering tools and infrastructure set-up☆44Updated 3 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆24Updated last year
- Where the Meltano team runs Meltano! Get it???☆25Updated last month
- dbt-core-interface is an MIT licensed high level wrapper for dbt-core that can be used to drive third party integrations such as servers,…☆31Updated 11 months ago
- Make simple storing test results and visualisation of these in a BI dashboard☆40Updated last week
- Data models for Hubspot built using dbt.☆34Updated last week
- ☆15Updated last year
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆71Updated last year
- ☆71Updated this week
- Sample configuration to deploy a modern data platform.☆86Updated 2 years ago
- Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and p…☆26Updated 5 years ago
- A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Da…☆24Updated 2 years ago
- Containerized end-to-end analytics of Spotify data using Python, dbt, Postgres, and Metabase☆123Updated 2 years ago
- New generation opensource data stack☆61Updated 2 years ago
- This repository is a production dbt pipeline example that model the profitability of an e-commerce business. Data is extracted and loaded…☆22Updated 5 months ago
- A Dagster plugin that allows you to run Meltano in Dagster☆43Updated 3 weeks ago
- Python wrapper for the Sling CLI tool☆43Updated last month
- A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.☆20Updated 2 years ago
- Cost Efficient Data Pipelines with DuckDB☆45Updated 3 months ago
- A curated list of awesome open source tools and commercial products to catalog, version, and manage data 🚀☆27Updated 2 years ago
- Repo for orienting dbt users to the Dagster asset framework☆50Updated 2 years ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆111Updated last week
- git push your data stack with Airbyte, Airflow, and dbt - 2022 Airflow Summit☆52Updated last year
- Data Tools Subjective List☆80Updated last year
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- Prefect integrations for working with OpenAI.☆36Updated 6 months ago
- ☆20Updated 3 years ago