valiantljk / h5sparkView external linksLinks
Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark
☆42Feb 17, 2021Updated 4 years ago
Alternatives and similar repositories for h5spark
Users that are interested in h5spark are comparing it to the libraries listed below
Sorting:
- A plugin to enable Apache Spark to read HDF5 files☆20Nov 17, 2016Updated 9 years ago
- Scientific Spark - a NASA AIST14 project☆86Mar 31, 2018Updated 7 years ago
- Kira is an astronomy image processing toolkit implemented with Apache Spark.☆15Feb 9, 2016Updated 10 years ago
- Explore the High-Resolution Rapid Refresh weather forecast output using Pyviz (hvplot and panel)☆15Jan 8, 2024Updated 2 years ago
- scikit-learn addon to operate on set/"group"-based features☆41Aug 8, 2016Updated 9 years ago
- Dependency and data pipeline management framework for Spark and Scala☆15Apr 8, 2017Updated 8 years ago
- hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs☆12Jul 2, 2019Updated 6 years ago
- Java Bindings (JNI) for bwa☆20Dec 15, 2016Updated 9 years ago
- FITS data source for Spark SQL and DataFrames☆22Apr 12, 2023Updated 2 years ago
- Source of paper “A critique of the CAP theorem”☆16Dec 14, 2015Updated 10 years ago
- ☆41Jul 19, 2017Updated 8 years ago
- Scala/Spark Project For Reading NetCDF☆21Jan 2, 2018Updated 8 years ago
- Python implementation of nonparametric nearest-neighbor-based estimators for divergences between distributions.☆48Mar 13, 2017Updated 8 years ago
- Parallel read alignment and variant calling using MapReduce☆18Feb 19, 2019Updated 6 years ago
- Automatic offload of user-written Spark kernels to accelerators☆18Oct 25, 2016Updated 9 years ago
- A composable framework for fast and scalable data analytics☆57Dec 12, 2022Updated 3 years ago
- Spark DataFrames for earth observation data☆19May 1, 2018Updated 7 years ago
- A collective communication library plugined into Hadoop☆23Apr 12, 2022Updated 3 years ago
- FITS to HDFITS conversion utility☆25Sep 11, 2023Updated 2 years ago
- TeraSort for Spark and Flink which uses a range partitioner based on sampling☆22Feb 5, 2016Updated 10 years ago
- Astronomy eXtensions for Spark: Fast, Scalable, Analytics of Billion+ row catalogs☆24Jan 6, 2023Updated 3 years ago
- MPI-oriented extension of the Spark computational model☆24Jun 5, 2018Updated 7 years ago
- launching and controlling spark on hpc clusters☆23Aug 6, 2022Updated 3 years ago
- Spark Package to read and write PLY, LAS and XYZ lidar point clouds using Spark SQL.☆23Dec 19, 2018Updated 7 years ago
- Multi-target API for graph analytics with Dask☆29Sep 3, 2024Updated last year
- GeoTrellis PointCloud library to work with any pointcloud data on Spark☆27Oct 5, 2020Updated 5 years ago
- Additional useful algorithms that can be used with spark.☆24Dec 24, 2014Updated 11 years ago
- Writing application logic for Spark jobs that can be unit-tested without a SparkContext☆76Jan 27, 2019Updated 7 years ago
- ☆29May 15, 2015Updated 10 years ago
- Data Science with Apache Spark and Spark Notebook☆30Jul 24, 2017Updated 8 years ago
- Documented examples of Jupyterhub deployment in HPC settings☆36Jun 11, 2024Updated last year
- ⚡️ Actions and Reducer Utilities for NGRX☆10Oct 17, 2019Updated 6 years ago
- ☆11Apr 28, 2023Updated 2 years ago
- SBT Plugin to ease working with JNI☆133Feb 9, 2026Updated last week
- Reproducing Distributed Systems and Experiments on Cloud☆39Sep 11, 2023Updated 2 years ago
- ☆33Jan 9, 2016Updated 10 years ago
- Benchmarks of artificial neural network library for Spark MLlib☆11Dec 3, 2015Updated 10 years ago
- Proximal Asynchronous SAGA☆13Nov 30, 2017Updated 8 years ago
- Active Learning for SN photometric classification☆10Oct 10, 2025Updated 4 months ago