giacbrd / SmartPipeline
A framework for rapid development of robust data pipelines following a simple design pattern
☆27Updated last year
Alternatives and similar repositories for SmartPipeline
Users that are interested in SmartPipeline are comparing it to the libraries listed below
Sorting:
- Versatile Metrics Collection for Python☆19Updated last year
- ☆36Updated 3 months ago
- A fully-featured multi-source data pipeline for continuously extracting knowledge from COVID-19 data.☆21Updated 3 years ago
- Simple, lightweight, extensible DAG framework for Python with a Kubeflow-like API☆79Updated last year
- dagster scikit-learn pipeline example.☆44Updated 2 years ago
- Graph Engine for Exploration and Search☆40Updated last year
- Ibis analytics, with Ibis (and more!)☆21Updated 7 months ago
- Where the Meltano team runs Meltano! Get it???☆28Updated last month
- A small Python module containing quick utility functions for standard ETL processes.☆35Updated 2 weeks ago
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆57Updated 3 years ago
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆43Updated this week
- A python client library for the Stitch Import API☆42Updated last year
- ☆37Updated 3 weeks ago
- A modern, enterprise-ready business intelligence web application. Unleash the value of your data. 📈 📉 📊☆33Updated 2 years ago
- A guide for leading a data (engineering) team☆62Updated last year
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆57Updated last month
- Run greatexpectations.io on ANY SQL Engine using REST API. Supported by FastAPI, Pydantic and SQLAlchemy as best data quality tool☆12Updated 2 weeks ago
- A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.☆20Updated 3 years ago
- Convert JSON Schemas to simple, human-readable Markdown documentation. Repo archived in favor of fork: sbrunner/jsonschema2md2☆26Updated last year
- Example Set up For DBT Cloud using Github Integrations☆11Updated 5 years ago
- scraping and querying documents for LLMs☆20Updated last week
- Prefect integrations for working with OpenAI.☆34Updated last year
- ☆31Updated 5 months ago
- Generate Python data structures and XML parser from Xschema (Python 3 port)☆11Updated 10 years ago
- Datailot-cli is the command line interface for accessing the AI teammate for engineers to ensure best practices in their SQL and dbt proj…☆29Updated last week
- convert sqlite database to duckdb database☆17Updated 11 months ago
- A framework for distributing flask apps across separate packages with minimal dependencies☆15Updated last year
- How to integrate a knowledge graph into a chatbot to do entity resolution☆7Updated 3 years ago
- Async bulk data ingestion and querying in various document, graph and vector databases via their Python clients☆36Updated last year
- Record matching and entity resolution at scale in Spark☆34Updated last year