Enabling Spark Optimization through Cross-stack Monitoring and Visualization
☆47Aug 23, 2017Updated 8 years ago
Alternatives and similar repositories for sparkoscope
Users that are interested in sparkoscope are comparing it to the libraries listed below
Sorting:
- A general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notif…☆18Nov 19, 2018Updated 7 years ago
- Apache Hadoop HDFS Data Node Scheduler☆13Jun 4, 2016Updated 9 years ago
- Apache Spark OpenCPU Executor (ROSE)☆26Jun 16, 2018Updated 7 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Apr 18, 2017Updated 8 years ago
- Quark is a data virtualization engine over analytic databases.☆100Jul 13, 2017Updated 8 years ago
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,369Aug 22, 2023Updated 2 years ago
- MapReduce performance testing using teragen and terasort☆18Aug 26, 2021Updated 4 years ago
- Profiling Spark Applications for Performance Comparison and Diagnosis☆17Nov 11, 2018Updated 7 years ago
- Drizzle integration with Apache Spark☆120Sep 11, 2018Updated 7 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Jul 7, 2016Updated 9 years ago
- [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O☆74Mar 2, 2018Updated 8 years ago
- All the things about TPC-DS in Apache Spark☆109Jun 15, 2023Updated 2 years ago
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…☆108Feb 1, 2018Updated 8 years ago
- H3 is an embedded object store in C, Python, and Java☆12Jul 7, 2021Updated 4 years ago
- Collection of HDP Tuning Tricks & Tips (unofficial guide)☆17Sep 26, 2017Updated 8 years ago
- Alerting and monitoring tool for Apache Spark☆23May 20, 2022Updated 3 years ago
- ☆16Jun 27, 2020Updated 5 years ago
- Flash attention implementation Minimal CUDA implementation of Flash Attention with tiled computation and online softmax. Educational imp…☆20Dec 27, 2025Updated 2 months ago
- Albis: High-Performance File Format for Big Data Systems☆21Jul 12, 2018Updated 7 years ago
- Training NVIDIA NeMo Megatron Large Language Model (LLM) using NeMo Framework on Google Kubernetes Engine☆16Apr 28, 2025Updated 10 months ago
- Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in…☆1,037Nov 21, 2022Updated 3 years ago
- Deploying machine learning models to Azure☆62Jun 28, 2019Updated 6 years ago
- The iterative broadcast join example code.☆71Oct 23, 2017Updated 8 years ago
- PostgreSQL and GreenPlum Data Source for Apache Spark☆35Jul 9, 2025Updated 8 months ago
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆816Mar 4, 2026Updated 2 weeks ago
- Euroleague and Eurocup Scrapper☆12Dec 8, 2022Updated 3 years ago
- ☆24Feb 4, 2021Updated 5 years ago
- ☆11Oct 11, 2022Updated 3 years ago
- ☆33Apr 23, 2019Updated 6 years ago
- Reusable shiny modules☆12Jan 29, 2016Updated 10 years ago
- Apache Spark Web Monitor Tool, varOne☆36Aug 26, 2016Updated 9 years ago
- Linux tools for monitoring processes written in bash, python, R, html and javascript☆12Aug 31, 2016Updated 9 years ago
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,007Oct 5, 2022Updated 3 years ago
- Stocator is high performing connector to object storage for Apache Spark, achieving performance by leveraging object storage semantics.☆114May 17, 2024Updated last year
- Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream …☆22Feb 6, 2017Updated 9 years ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Mar 2, 2026Updated 2 weeks ago
- Write your Spark data to Kafka seamlessly☆174Jul 10, 2024Updated last year
- Basic example of using Java to create a producer and consumer that work with Kafka on HDInsight. Also a demonstration of the streaming ap…☆30Sep 5, 2023Updated 2 years ago
- Bug detection framework for finding Finger tracable bugs in Linux☆20Mar 23, 2025Updated 11 months ago