Spark stream from kafka(json) to s3(parquet)
☆15Nov 8, 2018Updated 7 years ago
Alternatives and similar repositories for jaquet
Users that are interested in jaquet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- low-level helpers for Apache Spark libraries and tests☆16Dec 29, 2018Updated 7 years ago
- Unix tee, but for Kinesis streams☆12Oct 19, 2021Updated 5 years ago
- NuCypher for Kafka. Start building from this module (it fetches the appropriate branch from Kafka repository)☆17Oct 13, 2017Updated 9 years ago
- A type driven approach to string interpolation, aiming at consistent, secure, and only-human-readable logs and console outputs !☆14May 5, 2024Updated 2 years ago
- A testing DSL for kafka-streams☆14Aug 9, 2017Updated 9 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Simulation of job offers and CVs with real-time processing, classification, and analytics using Kafka, Ray, Spark, and Databricks. Includ…☆14Dec 25, 2024Updated last year
- Ansible scripts for deploying Kafka on EC2☆10Oct 7, 2016Updated 10 years ago
- An engineering report on using transactions in Kafka 0.11.0.0☆19Feb 27, 2018Updated 8 years ago
- Using Apache Airflow to author, run and monitor complex data pipelines.☆12Oct 24, 2018Updated 8 years ago
- My HackerRank Solutions : https://www.hackerrank.com/RohanKhude☆12Jul 13, 2016Updated 10 years ago
- Utilities for Apache Spark☆35Mar 5, 2016Updated 10 years ago
- Algorithms and Data Structures implemented in Java☆12Jul 28, 2019Updated 7 years ago
- Labs for "The Ultimate Hands-On Hadoop" covering Hadoop, Apache Hive, Hbase, Cassandra, MongoDB, Kafka, Flume, Drill, Phoenix, Presto, Sp…☆10Jan 7, 2019Updated 7 years ago
- ☆12Mar 15, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Data Quality Monitoring Tool☆15Dec 5, 2017Updated 8 years ago
- 一些机器学习的实践☆11Jun 29, 2022Updated 4 years ago
- PoC using scala that defines single-message protobuf schema per Kafka topic☆23Feb 7, 2020Updated 6 years ago
- 🌦️ Domain Ranker☆16Sep 7, 2019Updated 7 years ago
- Sample applications using Cascading☆20Jun 7, 2015Updated 11 years ago
- Translation of the QuickCheck properties in the paper "How to specify it!" by John Hughes into clojure test.check☆10Jul 19, 2019Updated 7 years ago
- Workshop for Spark and Databricks☆55Dec 6, 2019Updated 6 years ago
- Apache Cassandra CQL Sampler for Apache JMeter☆13Sep 30, 2016Updated 10 years ago
- Enhancing Kafka security, PlainSaslServer with LDAP binding and SimpleAclAuthorizer with LDAP group membership☆20Dec 11, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- How to use Parquet in Flink☆32May 2, 2017Updated 9 years ago
- Examples of various concurrency tasks☆10Jul 18, 2019Updated 7 years ago
- ☆39Oct 25, 2026Updated last week
- Create a data mart using Azure Data Factory as ELT / ETL, Azure Synapse as database and Power BI as visualization tool.☆19Apr 20, 2022Updated 4 years ago
- Java library for immutable human-friendly units☆19Apr 1, 2026Updated 7 months ago
- ☆10Feb 12, 2020Updated 6 years ago
- Pure Java ZeroMQ☆24Nov 9, 2015Updated 10 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Oct 15, 2022Updated 4 years ago
- Tools for administering a Cyanite cluster☆10Oct 16, 2017Updated 9 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- An interactive CLI tool for managing Kafka topics☆27Apr 15, 2019Updated 7 years ago
- Code and architecture diagrams for performance testing a few API approaches on AWS☆10Apr 20, 2019Updated 7 years ago
- Examples for Apache Oozie book☆18May 30, 2016Updated 10 years ago
- A library to simplify compound field partitioning, sorting and grouping in MapReduce.☆12Nov 14, 2014Updated 11 years ago
- json或SQL语言 转为flink或者spark流/批任务☆12Jun 21, 2022Updated 4 years ago
- Like jq, but with json pointers☆16Nov 30, 2025Updated 11 months ago
- ☆11Jul 18, 2011Updated 15 years ago