giacbrd / SmartPipelineLinks
A framework for rapid development of robust data pipelines following a simple design pattern
☆27Updated last year
Alternatives and similar repositories for SmartPipeline
Users that are interested in SmartPipeline are comparing it to the libraries listed below
Sorting:
- A small Python module containing quick utility functions for standard ETL processes.☆37Updated last month
- Create and manage data pipes with Meerschaum.☆154Updated this week
- ☆36Updated 5 months ago
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆58Updated 4 years ago
- dagster scikit-learn pipeline example.☆46Updated 2 years ago
- ☆71Updated last year
- dotML is a light-weight semantic layer written in Python.☆40Updated 2 years ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆66Updated last week
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 4 months ago
- Python DSL for setting up business intelligence rules☆73Updated last year
- Simple, lightweight, extensible DAG framework for Python with a Kubeflow-like API☆83Updated last year
- dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.☆57Updated 3 years ago
- Tools for working with Singer Taps and Targets☆61Updated last year
- KNOTS is an intuitive desktop application built to simplify the configuration of Singer pipelines☆67Updated 3 years ago
- Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.☆87Updated last year
- Deploy a Prefect flow to serverless AWS Lambda function☆35Updated 3 years ago
- Declare multi-table rules for SQLAlchemy update logic -- 40X more concise, Python for extensibility.☆48Updated 4 months ago
- ☆27Updated 2 weeks ago
- ☆33Updated 3 months ago
- An application to move data around☆15Updated 2 years ago
- Simple samples for writing ETL transform scripts in Python☆24Updated 3 weeks ago
- A guide for leading a data (engineering) team☆64Updated last year
- Code examples showing flow deployment to various types of infrastructure☆110Updated 3 years ago
- Distributed persistent Task Queue running on Dask☆38Updated 2 years ago
- Embedded Graph Database for Python. Lives inside your Python process. Quick setup. No server. Runs in notebooks, apps, even your browser.☆340Updated this week
- DuckDB Community Extension to prompt LLMs from SQL☆55Updated last week
- Make sense of it all. Semantic data modeling and analytics with a sprinkle of AI. https://totalhack.github.io/zillion/☆208Updated last month
- Lightweight configuration and access to multiple databases in a single project☆38Updated 2 years ago
- tap-postgres☆68Updated last year
- Easily sync your Postgres database to a Snowflake, ClickHouse, or DuckDB warehouse.☆84Updated last year