mozilla-services / mozilla-pipeline-schemasLinks
Schemas for Mozilla's data ingestion pipeline and data lake outputs
☆48Updated last week
Alternatives and similar repositories for mozilla-pipeline-schemas
Users that are interested in mozilla-pipeline-schemas are comparing it to the libraries listed below
Sorting:
- Documentation and implementation of telemetry ingestion on Google Cloud Platform☆86Updated this week
- Airflow configuration for Telemetry☆199Updated this week
- BigQuery import and processing pipelines☆68Updated 2 weeks ago
- A guide for Mozilla's developers and data scientists to analyze and interpret the data gathered by our data collection systems.☆97Updated 2 weeks ago
- ETL jobs for Firefox Telemetry☆29Updated 2 months ago
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆131Updated 5 years ago
- ☆47Updated last year
- Open source tools for Google Cloud Storage and Databases.☆63Updated last year
- ☆54Updated 8 years ago
- GCP extensions for Jupyter and JupyterLab☆56Updated this week
- Mozilla's Update Server☆103Updated this week
- Scrape and publish Telemetry probe data from Firefox☆25Updated this week
- A Fastly API client for Python☆77Updated last month
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 9 months ago
- ☆19Updated 10 years ago
- Mozilla Marketing Engineering and Operations Infrastructure☆59Updated 3 months ago
- Spark Streaming ETL jobs for Mozilla Telemetry☆18Updated 6 years ago
- Mozilla Services Data Pipeline☆30Updated 6 years ago
- Spark bindings for Mozilla Telemetry☆15Updated last week
- ☆65Updated 4 years ago
- Chatlytics is a data query and visualization platform for chat!☆13Updated 8 years ago
- Advertising Data Lakes and Workflow Automation☆51Updated 5 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆259Updated 2 years ago
- Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization s…☆53Updated 2 years ago
- Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP☆95Updated last year
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆152Updated 9 years ago
- ☆66Updated last year
- Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of s…☆173Updated last year
- A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (in…☆257Updated last month
- This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-bigquery-datatransfer☆84Updated 2 years ago