Jayvardhan-Reddy / BigData-Ecosystem-ArchitectureLinks
Life-cycle: Internal working of HDFS, SQOOP, HIVE, SPARK, HBASE, KAFKA with code.
☆15Updated 5 years ago
Alternatives and similar repositories for BigData-Ecosystem-Architecture
Users that are interested in BigData-Ecosystem-Architecture are comparing it to the libraries listed below
Sorting:
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- The Internals of Spark Structured Streaming☆419Updated 2 years ago
- Self-contained examples of Apache Spark streaming integrated with Apache Kafka.☆199Updated 7 years ago
- Spark structured streaming examples with using of version 3.5.1☆26Updated last year
- Examples of Spark 2.0☆212Updated 3 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆160Updated 2 years ago
- ☆199Updated 2 weeks ago
- The Internals of Spark SQL☆471Updated 2 weeks ago
- Kafka offset committer for structured streaming query☆39Updated 4 years ago
- Spark Streaming HBase Example☆96Updated 9 years ago
- Simple examle for Spark Streaming over Kafka topic☆106Updated 4 years ago
- Apache Spark™ and Scala Workshops☆264Updated 11 months ago
- ☆310Updated 6 years ago
- ☆24Updated 9 years ago
- ☆240Updated 3 years ago
- CSD for Apache Airflow☆20Updated 5 years ago
- ☆105Updated 5 years ago
- A tool for monitoring and tuning Spark jobs for efficiency.☆358Updated 2 years ago
- This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language☆567Updated last year
- A modern real-time streaming application serving as a reference framework for developing a big data pipeline, complete with a broad range…☆42Updated 5 years ago
- DataQuality for BigData☆144Updated last year
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆50Updated 4 years ago
- A docker using the airflow with Hadoop ecosystem (hive, spark, and sqoop)☆12Updated 4 years ago
- Project for reading data from kafka and writing to kafka and HBase with kerberos☆24Updated 8 years ago
- Spark connector for SFTP☆100Updated 2 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Updated 8 years ago
- Spark, Spark Streaming and Spark SQL unit testing strategies☆216Updated 8 years ago
- Examples for High Performance Spark☆511Updated 8 months ago
- A Spark SQL extension which provides SQL Standard Authorization for Apache Spark | This repo is contributed to Apache Kyuubi | 项目已迁移至 Apa…☆177Updated 3 years ago
- Spark Examples☆125Updated 3 years ago