opentrials / opentrials-airflow
Configuration and definitions of Airflow for OpenTrials
☆18Updated 7 years ago
Related projects: ⓘ
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- automatic visual data explorer for datasette☆12Updated last year
- Streaming newline delimited JSON I/O.☆12Updated last year
- T4 is now in production as Quilt 3☆64Updated 5 years ago
- Versioned domain model. Python library for revisioning/versioning of databases.☆44Updated 3 years ago
- Generate SQL tables, load and extract data, based on JSON Table Schema descriptors.☆60Updated last year
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆53Updated 6 years ago
- Example Repository for Building Complex Data Pipeline with Luigi +TD☆24Updated 9 years ago
- A Pachyderm deep learning tutorial for conference workshops☆19Updated 7 years ago
- Manage and load dataprotocols.org Data Packages☆27Updated 9 years ago
- An opinionated template for spinning up a dask cluster based on docker.☆13Updated 6 years ago
- Query GitHub API v4 using GraphQL☆15Updated 6 years ago
- Slack notifications for the Luigi workflow manager☆46Updated 3 years ago
- KnowledgeRepo + JupyterLab☆48Updated 3 months ago
- A Singer.io Target for the Stitch Import API☆26Updated 2 weeks ago
- An example of running JupyterLab on Heroku, with Amazon S3.☆52Updated 8 months ago
- S3 backed ContentsManager for jupyter notebooks☆13Updated 8 years ago
- Optional extensions for petl based on third party libraries.☆44Updated 9 years ago
- pytest support for airflow☆12Updated 3 years ago
- CLI for creating databases for Data Quality Dashboards.☆19Updated 4 years ago
- Transform flat data structures into nested object graphs matching JSON schema definitions.☆28Updated 8 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 5 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 5 years ago
- python parallel map on kubernetes☆34Updated 7 years ago
- Generate Pandas frames, load and extract data, based on JSON Table Schema descriptors.☆52Updated 3 years ago
- Python language parser for a tabular format for structured metadata. http://metatab.org☆17Updated 11 months ago
- Read and write Python objects to S3, caching them on your hard drive to avoid unnecessary IO.☆24Updated 6 years ago
- ☆19Updated this week
- Framework for processing data packages in pipelines of modular components.☆118Updated last year
- Package generating elasticsearch mapping from jsonschemas☆14Updated 5 years ago