Demonstrating the capabilities of DuckDB as a transformation engine for data lakes
☆34Oct 8, 2024Updated last year
Alternatives and similar repositories for duckdb-pipeline
Users that are interested in duckdb-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13May 17, 2025Updated last year
- ☆17Mar 10, 2025Updated last year
- ScaleDP is an Open-Source extension of Apache Spark for Document Processing☆18Dec 2, 2025Updated 8 months ago
- Data Engineering with Scala, published by Packt☆28Apr 22, 2026Updated 3 months ago
- ☆12Aug 8, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ms-dataverse is a Python module for Microsoft Dataverse, offering a lightweight ORM to query, create, update, and delete entities. Utiliz…☆13Apr 10, 2023Updated 3 years ago
- The official documentation of the City of Boston's Analytics Team.☆13Jan 21, 2025Updated last year
- Scrapper and analyzer of shared scooter data☆11Jul 30, 2024Updated 2 years ago
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆28Jun 20, 2025Updated last year
- Esse repositório contém todos os códigos que desenvolvi durante o curso Leitura e Manipulação de Dados em Python oferecido no meu canal n…☆13Aug 9, 2021Updated 5 years ago
- Java wrapper for NBA player/team/league stats and even more!☆10Sep 26, 2019Updated 6 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Apr 5, 2026Updated 4 months ago
- End-to-end Data Project (DA/DS/DE/MLOps) - retail/e-commerce - interpretable dynamic clustering☆22Jul 12, 2025Updated last year
- Dashboard showcasing Conjoint Analysis for the Electric Vehicle Lease Market (as at January 2020) in San Francisco☆15Feb 19, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Provide manufacturing information models☆15Feb 23, 2026Updated 5 months ago
- ☆14Aug 13, 2023Updated 3 years ago
- python library for Nexon OpenAPI☆13Jul 13, 2024Updated 2 years ago
- Databricks CI/CD using Azure DevOps☆21Nov 1, 2022Updated 3 years ago
- Azure AI Translator demos☆29Mar 19, 2026Updated 4 months ago
- Demo illustrating Spring Boot deployment on Kubernetes with automatic manifests generation with Dekorate☆11Updated this week
- Data warehouse tech stack with PostgreSQL, DBT and Airflow☆20Dec 29, 2025Updated 7 months ago
- Kafka client using kotlin flow and coroutines☆14Dec 22, 2021Updated 4 years ago
- Birds 400-Species Image Classification using Pytorch Metric Learning (Triplet Margin Loss)☆13Nov 1, 2022Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Open Source Kafka Connect Connector plugin repository built and maintained by Instaclustr☆12May 13, 2026Updated 3 months ago
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck☆237May 15, 2026Updated 2 months ago
- A data pipeline solution for collecting options data at scale.☆19Jun 28, 2023Updated 3 years ago
- This repo demonstrates an Apache Arrow Flight server implementation in Kubernetes.☆12Oct 25, 2024Updated last year
- Connect to the Dynamics 365 / Dataverse Web API using interactive login☆27Oct 10, 2025Updated 10 months ago
- The client library that is used to ingest data into the backend of the https://github.com/rehanvdm/serverless-website-analytics CDK compo…☆26Nov 26, 2024Updated last year
- Spring WebFlux with coroutines support and suspending kafka message dispatch.☆12Oct 16, 2019Updated 6 years ago
- This is project documentation templates derived from CRISP-DM to be used for Data Engineering projects.☆66Aug 16, 2021Updated 4 years ago
- Custom visualization with AWS AppSync using Amazon Athena as a data source. Built with AWS Amplify CLI.☆34Mar 30, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The source code including python files, config files, Dockerfile etc. for the SageMaker demo presented at the AWS London Summit 2018☆14Jun 26, 2018Updated 8 years ago
- ☆12Aug 26, 2024Updated last year
- Open-source Semantic Sidecar for AI, analytics, and governed data systems. Compiles declarative YAML models into optimized SQL, semantic …☆71Updated this week
- An open-sourced personal card site template, built with Astro, HTML and CSS.☆45May 30, 2024Updated 2 years ago
- This demo shows how to capture data changes from relational databases (Oracle and PostgreSQL) and stream them to Confluent Cloud, use ksq…☆17Jan 10, 2025Updated last year
- CLI secret management☆16Updated this week
- CalData infrastructure☆25Updated this week