airbnb / omniduct
A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (including HDFS, Hive, Presto, MySQL, etc).
☆255Updated 11 months ago
Alternatives and similar repositories for omniduct:
Users that are interested in omniduct are comparing it to the libraries listed below
- Data ingestion library for Amundsen to build graph and search index☆205Updated last year
- Front-end service library for Amundsen☆280Updated last week
- Metadata service library for Amundsen☆83Updated last month
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆261Updated last year
- Writes the Singer format from Python☆560Updated last month
- ETLy is an add-on dashboard service on top of Apache Airflow.☆68Updated last year
- Apache Superset (incubating) is a modern, enterprise-ready business intelligence web application☆102Updated last year
- Big Data Processing Framework - Unified Data API or SQL on Any Storage☆245Updated 4 months ago
- transformpy is a Python 2/3 module for doing transforms on "streams" of data☆29Updated 7 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆200Updated last week
- Airflow configuration for Telemetry☆186Updated this week
- A luigi powered analytics / warehouse stack☆88Updated 8 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- A dynamic graph-based metric computation engine.☆48Updated last year
- 📚 Notebook storage and publishing workflows for the masses☆202Updated 3 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- Search service library for Amundsen☆54Updated last week
- ☆73Updated 2 months ago
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆233Updated 2 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Open source Flotilla☆193Updated this week
- 🚎 Notebook sharing hub☆498Updated last year
- Change Data Capture (CDC) service☆442Updated 10 months ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 4 years ago
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆116Updated 2 years ago
- T4 is now in production as Quilt 3☆64Updated 5 years ago
- A wrapper for libhdfs3 to interact with HDFS from Python☆136Updated 4 years ago
- Data analysis and reporting tool for quick access to custom charts and tables in Jupyter Notebooks and in the shell.☆120Updated last year
- Data models for snowplow analytics.☆128Updated 2 months ago
- ☆199Updated last year