airbnb / omniductLinks
A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (including HDFS, Hive, Presto, MySQL, etc).
☆254Updated last year
Alternatives and similar repositories for omniduct
Users that are interested in omniduct are comparing it to the libraries listed below
Sorting:
- Data ingestion library for Amundsen to build graph and search index☆205Updated last year
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆261Updated last year
- Front-end service library for Amundsen☆280Updated 2 weeks ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 2 months ago
- ☆75Updated 4 months ago
- Airflow configuration for Telemetry☆191Updated 2 weeks ago
- Metadata service library for Amundsen☆83Updated last month
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated last year
- A luigi powered analytics / warehouse stack☆88Updated 8 years ago
- Writes the Singer format from Python☆568Updated 3 weeks ago
- DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.☆266Updated 3 months ago
- Tool to automate data quality checks on data pipelines☆255Updated 2 years ago
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆477Updated this week
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 3 years ago
- Airflow declarative DAGs via YAML☆132Updated last year
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Open source Flotilla☆194Updated last month
- Apache Superset (incubating) is a modern, enterprise-ready business intelligence web application☆103Updated last year
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 2 years ago
- Search service library for Amundsen☆54Updated last month
- 📚 Notebook storage and publishing workflows for the masses☆202Updated 3 years ago
- 🚎 Notebook sharing hub☆500Updated last year
- a declarative ETL framework that enforces data engineer best practices☆39Updated 7 years ago
- Big Data Processing Framework - Unified Data API or SQL on Any Storage☆245Updated this week
- ☆199Updated last year
- Serializes data into a JSON format using AVRO schema.☆137Updated 3 years ago
- transformpy is a Python 2/3 module for doing transforms on "streams" of data☆29Updated 8 years ago