mozilla-services / mozilla-pipeline-schemasLinks
Schemas for Mozilla's data ingestion pipeline and data lake outputs
☆48Updated this week
Alternatives and similar repositories for mozilla-pipeline-schemas
Users that are interested in mozilla-pipeline-schemas are comparing it to the libraries listed below
Sorting:
- Documentation and implementation of telemetry ingestion on Google Cloud Platform☆83Updated this week
- Airflow configuration for Telemetry☆192Updated this week
- ETL jobs for Firefox Telemetry☆28Updated 3 months ago
- A guide for Mozilla's developers and data scientists to analyze and interpret the data gathered by our data collection systems.☆91Updated 2 weeks ago
- BigQuery import and processing pipelines☆68Updated this week
- ☆46Updated last year
- Open source tools for Google Cloud Storage and Databases.☆63Updated last year
- Spark bindings for Mozilla Telemetry☆15Updated last year
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆129Updated 4 years ago
- Scrape and publish Telemetry probe data from Firefox☆24Updated last week
- Mozilla's Update Server☆102Updated this week
- Mozilla Services Data Pipeline☆30Updated 6 years ago
- Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of s…☆171Updated last year
- ☆66Updated 11 months ago
- A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (in…☆254Updated 2 weeks ago
- Bigquery ETL☆320Updated this week
- Advertising Data Lakes and Workflow Automation☆50Updated 4 years ago
- DIY commercial datasets on Google Cloud Platform☆89Updated last week
- Mozilla Marketing Engineering and Operations Infrastructure☆59Updated 5 months ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Updated 2 years ago
- ☆12Updated 2 years ago
- Library to access and aggregate several Mozilla data sources.☆12Updated 3 weeks ago
- ☆54Updated 8 years ago
- A Singer (https://singer.io) target that writes data to Google BigQuery.☆39Updated 4 years ago
- Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP☆93Updated 11 months ago
- Database plugins☆13Updated last week
- Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization s…☆54Updated last year
- This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-dataproc☆48Updated last year
- Spark Streaming ETL jobs for Mozilla Telemetry☆18Updated 5 years ago
- Ephemeral Hadoop clusters using Google Compute Platform☆136Updated 3 years ago