airbnb / omniduct
A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (including HDFS, Hive, Presto, MySQL, etc).
☆256Updated 9 months ago
Alternatives and similar repositories for omniduct:
Users that are interested in omniduct are comparing it to the libraries listed below
- Data ingestion library for Amundsen to build graph and search index☆205Updated 11 months ago
- Front-end service library for Amundsen☆280Updated last week
- Apache Superset (incubating) is a modern, enterprise-ready business intelligence web application☆102Updated last year
- Writes the Singer format from Python☆550Updated 5 months ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Updated last year
- Fast iterative local development and testing of Apache Airflow workflows☆197Updated 2 months ago
- Metadata service library for Amundsen☆83Updated last month
- Airflow configuration for Telemetry☆184Updated this week
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated last year
- A dynamic graph-based metric computation engine.☆48Updated last year
- ☆73Updated last week
- transformpy is a Python 2/3 module for doing transforms on "streams" of data☆29Updated 7 years ago
- Open Source Self-service Business Intelligence with Version Control☆322Updated 2 years ago
- Tool to automate data quality checks on data pipelines☆254Updated 2 years ago
- Change Data Capture (CDC) service☆441Updated 8 months ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆79Updated 2 weeks ago
- Open source Flotilla☆193Updated this week
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆627Updated this week
- A Getting Started Guide for developing and using Airflow Plugins☆94Updated 6 years ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆123Updated 3 years ago
- afctl helps to manage and deploy Apache Airflow projects faster and smoother.☆130Updated 2 years ago
- ☆198Updated last year
- ☆127Updated 4 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Iceberg is a table format for large, slow-moving tabular data☆479Updated last year
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆106Updated this week
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 2 years ago
- A Python implementation of Apache Kafka Streams☆311Updated 6 years ago
- A pure Python implementation of Apache Spark's RDD and DStream interfaces.☆268Updated 6 months ago
- Data models for snowplow analytics.☆127Updated 3 weeks ago