nialloriordan / airbyte-airflow-scraper
Pipeline to scrape data from Linkedin using Airbyte and Airflow
☆25Updated 2 years ago
Alternatives and similar repositories for airbyte-airflow-scraper:
Users that are interested in airbyte-airflow-scraper are comparing it to the libraries listed below
- POC integration Airbyte+Dagster+Langchain☆13Updated last year
- ☆46Updated this week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆144Updated 3 weeks ago
- Chat with your Database, no more writing SQL queries☆30Updated last year
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆14Updated last year
- Scraping Wikipedia by combining LangChain's agents and tools with OpenAI's LLMs and function calling☆27Updated last year
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆32Updated last year
- This repository is a production dbt pipeline example that model the profitability of an e-commerce business. Data is extracted and loaded…☆23Updated 10 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆41Updated 5 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- A Langchain driven project to create flexible LLM bots on Google Cloud Platform☆39Updated last year
- Baker is an AI powered app that helps you find recipes and avoid food waste☆14Updated 3 months ago
- Low-code Python library enabling access to APIs, tools, data sources in seconds.☆59Updated 9 months ago
- Sample configuration to deploy a modern data platform.☆88Updated 3 years ago
- ☆36Updated last month
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆82Updated last year
- Streamlit application to explore Snowflake Tables☆39Updated last year
- Data models for Hubspot built using dbt.☆35Updated last week
- A Chat App built with embedchain and streamlit☆41Updated last year
- Adding NeMo Guardrails to a LlamaIndex RAG pipeline☆36Updated last year
- Best practices for data workflows, integrations with the Modern Data Stack (MDS), Infrastructure as Code (IaC), Cloud Provider Services☆25Updated last month
- Streamlit application that helps users analyze RFP's using the latest Gemini 2.0 Flash Experimental LLM.☆13Updated 4 months ago
- Examples showing real-life use cases for fal + dbt☆22Updated 3 years ago
- A basic streamlit application that uses Mito for data importing and cleaning.☆23Updated last year
- ☆16Updated last year
- Cost Efficient Data Pipelines with DuckDB☆52Updated 8 months ago
- ☆33Updated 9 months ago
- ☆16Updated last year
- streamlit dashboard to analyse data☆12Updated last year
- Documentation for Ploomber Cloud☆34Updated 2 weeks ago