airbnb / omniductLinks
A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (including HDFS, Hive, Presto, MySQL, etc).
☆257Updated last month
Alternatives and similar repositories for omniduct
Users that are interested in omniduct are comparing it to the libraries listed below
Sorting:
- Data ingestion library for Amundsen to build graph and search index☆204Updated last year
- Front-end service library for Amundsen☆278Updated 2 months ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆259Updated 2 years ago
- ☆75Updated 10 months ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 3 weeks ago
- Metadata service library for Amundsen☆82Updated last week
- ETLy is an add-on dashboard service on top of Apache Airflow.☆68Updated 2 years ago
- Tool to automate data quality checks on data pipelines☆257Updated 3 years ago
- Airflow configuration for Telemetry☆198Updated this week
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 7 years ago
- Airflow workflow management platform chef cookbook.☆70Updated 6 years ago
- REST-like API exposing Airflow data and operations☆61Updated 7 years ago
- Open source Flotilla☆195Updated last week
- Writes the Singer format from Python☆576Updated 2 months ago
- Big Data Processing Framework - Unified Data API or SQL on Any Storage☆250Updated 6 months ago
- DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.☆267Updated 9 months ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆115Updated this week
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 7 years ago
- Pylint plugin for static code analysis on Airflow code☆97Updated 5 years ago
- Apache (Py)Spark type annotations (stub files).☆118Updated 3 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated 2 years ago
- Data models for snowplow analytics.☆129Updated last month
- An example mini data warehouse for python project stats, template for new projects☆178Updated 5 years ago
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 3 years ago
- 📚 Notebook storage and publishing workflows for the masses☆201Updated 4 years ago
- A Python framework for data processing on GCP.☆120Updated 9 months ago
- Search service library for Amundsen☆54Updated last week
- An extendable Docker image for Airbnb's Superset platform, previously known as Caravel.☆114Updated 3 years ago