Jayvardhan-Reddy / BigData-Ecosystem-ArchitectureLinks
Life-cycle: Internal working of HDFS, SQOOP, HIVE, SPARK, HBASE, KAFKA with code.
☆15Updated 6 years ago
Alternatives and similar repositories for BigData-Ecosystem-Architecture
Users that are interested in BigData-Ecosystem-Architecture are comparing it to the libraries listed below
Sorting:
- Spark Streaming HBase Example☆22Updated 9 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- Self-contained examples of Apache Spark streaming integrated with Apache Kafka.☆199Updated 7 years ago
- The Internals of Spark Structured Streaming☆422Updated 3 weeks ago
- Spark structured streaming examples with using of version 3.5.1☆26Updated last year
- Examples of Spark 2.0☆212Updated 4 years ago
- ☆105Updated 6 years ago
- Kafka offset committer for structured streaming query☆40Updated 4 years ago
- Apache Spark™ and Scala Workshops☆263Updated last year
- Spark Streaming HBase Example☆95Updated 9 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆161Updated 3 years ago
- Write your Spark data to Kafka seamlessly☆174Updated last year
- Custom state store providers for Apache Spark☆92Updated 9 months ago
- ☆240Updated 4 years ago
- Scala examples for learning to use Spark☆445Updated 5 years ago
- Project for reading data from kafka and writing to kafka and HBase with kerberos☆24Updated 9 years ago
- A docker using the airflow with Hadoop ecosystem (hive, spark, and sqoop)☆12Updated 4 years ago
- DataQuality for BigData☆144Updated last year
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆51Updated 5 years ago
- ☆313Updated 7 years ago
- Spark, Spark Streaming and Spark SQL unit testing strategies☆216Updated 9 years ago
- ☆103Updated 5 years ago
- A Spark Atlas connector to track data lineage in Apache Atlas☆265Updated 3 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆586Updated last year
- Simple examle for Spark Streaming over Kafka topic☆107Updated 5 years ago
- Spark connector for SFTP☆98Updated 2 years ago
- Spark Examples☆126Updated 3 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 7 years ago
- ☆27Updated 4 years ago
- A modern real-time streaming application serving as a reference framework for developing a big data pipeline, complete with a broad range…☆42Updated 5 years ago