airbnb / omniductLinks
A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (including HDFS, Hive, Presto, MySQL, etc).
☆256Updated 4 months ago
Alternatives and similar repositories for omniduct
Users that are interested in omniduct are comparing it to the libraries listed below
Sorting:
- Data ingestion library for Amundsen to build graph and search index☆204Updated last year
- Airflow configuration for Telemetry☆197Updated last week
- Front-end service library for Amundsen☆279Updated this week
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 3 months ago
- ☆75Updated 8 months ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆68Updated 2 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 7 years ago
- Tool to automate data quality checks on data pipelines☆254Updated 3 years ago
- Metadata service library for Amundsen☆82Updated 4 months ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- transformpy is a Python 2/3 module for doing transforms on "streams" of data☆28Updated 8 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 7 years ago
- Writes the Singer format from Python☆572Updated 3 weeks ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆125Updated 4 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- An example mini data warehouse for python project stats, template for new projects☆178Updated 5 years ago
- Snowplow event tracker for Python. Add analytics to your Python and Django apps, webapps and games☆45Updated 2 weeks ago
- DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.☆267Updated 7 months ago
- Open source Flotilla☆196Updated last week
- Tough and flexible tools for data analysis, transformation, validation and movement.☆139Updated last year
- Convert JSON files to Parquet using PyArrow☆97Updated last year
- An extendable Docker image for Airbnb's Superset platform, previously known as Caravel.☆114Updated 3 years ago
- Helpers & syntactic sugar for PySpark.☆62Updated 2 years ago
- Official repository for pygrametl - ETL programming in Python☆298Updated last month
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆486Updated last week
- A pure Python implementation of Apache Spark's RDD and DStream interfaces.☆271Updated last year
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 5 years ago