project-alchemist / Alchemist
An HPC Interface for data analysis platforms
☆22Updated 4 years ago
Related projects: ⓘ
- Spark Shuffle Optimization with RDMA+AEP☆30Updated last year
- Alchemist: an Apache Spark<->MPI interface☆26Updated 6 years ago
- Albis: High-Performance File Format for Big Data Systems☆21Updated 6 years ago
- Fast I/O plugins for Spark☆41Updated 3 years ago
- Parameter Server implementation in Apache Flink.☆14Updated 6 years ago
- Willump Is a Low-Latency Useful Machine learning Platform.☆43Updated last year
- [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples☆70Updated 4 years ago
- A composable framework for fast and scalable data analytics☆57Updated last year
- Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …☆13Updated 2 months ago
- Mirror of Apache crail (Incubating)☆147Updated 2 years ago
- Factorized Machine Learning with NumPy☆11Updated 3 years ago
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆44Updated 10 months ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Updated 8 years ago
- Code for Ernest☆32Updated last year
- UI to run SQL on Delta Lake tables and visualize the variations of the result among tables versions☆11Updated 4 years ago
- Rheem - a cross-platform data processing system☆5Updated 2 years ago
- Parquet file generator☆22Updated 6 years ago
- Patched version of dbgen☆26Updated 6 months ago
- Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…☆20Updated 6 months ago
- A library for exporting Spark ML models and pipelines to PFA☆54Updated 5 years ago
- ☆19Updated 3 years ago
- XGBoost GPU accelerated on Spark example applications☆51Updated 2 years ago
- ☆53Updated this week
- a native c/c++ hdfs client (downstream fork from apache-hawq)☆40Updated last month
- Quickstep Project☆27Updated 5 years ago
- MPI-oriented extension of the Spark computational model☆24Updated 6 years ago
- Java read and write example for Apache Arrow☆33Updated 6 years ago
- A place in which we publish scripts for reproducible benchmarks.☆107Updated 4 years ago
- Spark GPU and SIMD Support☆61Updated 4 years ago
- Generic driver for LDBC Graphalytics implementation☆78Updated 9 months ago