airbnb / omniduct
A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (including HDFS, Hive, Presto, MySQL, etc).
☆255Updated 10 months ago
Alternatives and similar repositories for omniduct:
Users that are interested in omniduct are comparing it to the libraries listed below
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆261Updated last year
- Data ingestion library for Amundsen to build graph and search index☆205Updated last year
- Front-end service library for Amundsen☆280Updated 3 weeks ago
- Metadata service library for Amundsen☆83Updated 2 weeks ago
- Fast iterative local development and testing of Apache Airflow workflows☆198Updated 3 months ago
- Writes the Singer format from Python☆556Updated 2 weeks ago
- transformpy is a Python 2/3 module for doing transforms on "streams" of data☆29Updated 7 years ago
- Apache Superset (incubating) is a modern, enterprise-ready business intelligence web application☆102Updated last year
- Change Data Capture (CDC) service☆442Updated 9 months ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆70Updated last year
- a declarative ETL framework that enforces data engineer best practices☆39Updated 7 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- Prometheus Exporter for Airflow☆160Updated 9 months ago
- 🚎 Notebook sharing hub☆498Updated last year
- A luigi powered analytics / warehouse stack☆88Updated 8 years ago
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 2 years ago
- Search service library for Amundsen☆54Updated 11 months ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Data models for snowplow analytics.☆128Updated last month
- Airflow declarative DAGs via YAML☆132Updated last year
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆123Updated 3 years ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆79Updated this week
- ReAir is a collection of easy-to-use tools for replicating tables and partitions between Hive data warehouses.☆283Updated 6 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- A dynamic graph-based metric computation engine.☆48Updated last year
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆116Updated 2 years ago
- ☆73Updated last month
- Tool to automate data quality checks on data pipelines☆254Updated 2 years ago
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆628Updated last week