Netflix / pygenieLinks
☆75Updated 9 months ago
Alternatives and similar repositories for pygenie
Users that are interested in pygenie are comparing it to the libraries listed below
Sorting:
- A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (in…☆257Updated 3 weeks ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 7 years ago
- Thin-client metrics library for use with Atlas and SpectatorD☆48Updated 2 months ago
- Deploy dask on YARN clusters☆69Updated last year
- Amazon S3 filesystem for PyFilesystem2☆158Updated last year
- T4 is now in production as Quilt 3☆64Updated 6 years ago
- Python stream processing for humans☆189Updated 3 weeks ago
- 📚 Notebook storage and publishing workflows for the masses☆201Updated 4 years ago
- 🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)☆141Updated 2 years ago
- IP Address dtype and block for pandas☆105Updated 2 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆115Updated this week
- Airflow configuration for Telemetry☆197Updated last week
- Data pipelines from re-usable components☆107Updated last month
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- A pandas.DataFrame-based ORM.☆85Updated 3 years ago
- Serializes data into a JSON format using AVRO schema.☆138Updated 3 years ago
- Data analysis and reporting tool for quick access to custom charts and tables in Jupyter Notebooks and in the shell.☆123Updated last year
- A python client library for the Stitch Import API☆44Updated last year
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 7 years ago
- Dataflow programming for python.☆292Updated 2 years ago
- Set of iPython and Jupyter extensions to improve user experience☆50Updated 6 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆259Updated 2 years ago
- Optional extensions for petl based on third party libraries.☆45Updated 10 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated last week
- Concurrent appendable key-value storage☆107Updated last year
- Convert JSON files to Parquet using PyArrow☆98Updated last year
- A wrapper for libhdfs3 to interact with HDFS from Python☆137Updated 4 years ago
- Fork of aio-libs/aiokafka☆28Updated 2 years ago
- Tough and flexible tools for data analysis, transformation, validation and movement.☆140Updated last year